CO 


OTPUTING  EQUILIBRIUM  COMPOSITIONS 
OF  IDEAL  CHEMICAL  SYSTEMS 

BY 

JAMES  Ho  BIGELOW 

TECHNICAL  REPORT  NO.  70-4 
MARCH  1970 


P  T)  O 


Ut 
V 

,  ,  >  .v.-i 

Li'.  ; 


(iTti. 
t  w  »  .. 


n 


ii 


-~t£/ 


TfU6  docmejU  hoA  bzen  appfiovzd  {^on.  public.  KztcuAC  and  Aotc; 
iX6  dUiyUbation  ii  antmUcd, 


Operat  ions 

Research 

House 


Stanford 

University 


CALIFORNIA 


COMPUTING  EQUILIBRIUM'  COMPOSITIONS,. 
OF  IDEAL  CHEMICAL  SYSTEMS 

by 

JAMES  H.  BIGELOW 


TECHNICAL  REPORT  p.  70-4 
MARCH  1970 


Department  of  Operations  Research- 
Stanford  University 

Stanford,  California  .  •  ■»  • 


Research^  and  reproduction  of  this  report  was  partially  supported  by 
Office  of  Naval  Research,  Contract  N-00014-767-A-011 2-001 1 ;  U.S.  Atomic 
Energy  Commission,  Contract  AT(04,-3)  326  PA#18;,  National  Science 
Foundation,  Grant  GP'9329;  U.S.  Army  Res.earch  Office,,  Contract 
PAHC04-67-0028;  and  National  institute  of  Healthy  Grant  GM  14789-02'; 

Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the 
United' States  Government.  THis  docum,ent  has  been  approved'  for  public 
release  and  sale;  its  distribution  is  unlimited. 


CdMTl'.N'rS 


Section 

I.  iNTROBiiCTION  . . .  1 

n.  PRIMAL  METHODS . .  .  .  .  5: 

1.  The  Augmented  Form  . . ,  .  .  5 

2;  The  Reduced  Fcm  ^  .  8 

3.  Thd'  General  Lihear-Logarltlimic  Problem  .  10- 

4..  The  Linear  Approximation  Method  .  .  .  ,  11 

5.  The  Quadratic  Approximation >Method  ...  14 

6'.  The  Basic  Algorithm-  . . .  16 


1.  The  Reduced  Generalized  Linear  Program  .  22 

2.  Lov7cr  Bounds  . . ^  .  .  30 

3;  The  Modified  RQM  Algoritlra  . . 35 

4-.  The  Other  Methods . .  .  42 

•ly.,  DUAL  MJITHODS  .  ;  .  .  . . .  43 

1.  The  Dual  Augmented  Linear  Method  ....  44 

,  2 .  The  Dual  For.imlation  .  . . .  .  .  ..  47 

3-.  Solving  the  Dual  . . .  54 

4.  Comparisoii  of  the  Dual  Methods  ......  5? 

5.  Degeneracy  and  the  Dual  Method's  ....  60 

6.  Convergence  of  Dual  Methods  . .  i  §2 

Appendix.  . . .  .  .  . . . . 6'3 

REFERENCHS . - . .  70 


FiiECEDING  PAGE  BlAHi^ 


I-..  ;r.NTRODUCTIQN 

A  single-  or  hriului-phase  chemical  equi'Mbriurii  probiem 
may  be  expressed  as  a  nonlinear  prograniming  problem.  Thus 
to  find  the  equilibftam  composition  of  a  chemical  system 
one  need  only  minimize  a  .particular  nonlinear  function  (the 
free  energy)  (f  composition  subject  to  certain  linTear  con¬ 
straints  (the  mass'-f  alance  laws).  The  free,  energy  is  defined 
on  the  nonnegative  orthant  of  n-space,  where  it  is  continuous, 
convex,  and  homogeneous  of  degree  one.  In  the  interior  of 
its  domain  it  is  infinitely  differentiable,;  but.  at  the  b6un4- 
afy,  the  directional  derivative  may  become  infinite. 

In  this  paper,  the  phrase  "chemical  equilibrium  problem" 
refers  only  to  a  problem  with  a  iparticuiar  mathematical  form. 
Problems  of  this  form  arise  in  many  situations  not  classically 
denoted  .chemical  equilibrium  problems.  For  example,  the  dual 
to  a  geometric-  programming  problem- 1.1,  IF  has  this  form. 

Alsoi,  steaily-state  .problems,  many  of  which- arise  naturally 
in  the  chemical  laboratory,,  or  in  in.dustfy,  can  often  be 
represented  in-  this  form.. 

The  chemical  equilibrium  problem,  then,  is  the  problem. 

St  -  ,  PRECEpS  PAGE  BIAS 
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of  minimizing  a  function  5^2*  '*  ♦  ?  >  >  defined  below, 

subject  to  the- linear  constraints 
n 

('I;‘l^  2  a.  .x*  bj  j  X,  ■*  1,^  '2,  O'#  t  f  m 

•  jol  1 

and  the  inequalities. 


\(1.2)  xj  >0,  j  »  1,  1,  , ,  ,  y  n.. 

The  a^j  and  are,  given,  real  constants.  We  assume;  that 
the  nv  equations  (I.l),  are  linearly  independent  and,  sio 
that  the  problem  will -be  nontrivial,  that  m  <  n. 

The;  n  variables  x.  are  partitioned  into  p  nonedpty 
subsets  called  compartments,  or  ;phases.  We  denote  the 
compartment  containing  the  variable  x^  by  <j>.  We  may 
indicate  .that  x^  and  x^^  arc  in  the  same  compartment  by 
writing: 


j  €  <k>  of  k  e  <j>  or  *=  <lo  .. 

Each  compartifient  has  associated'  with  it  a  sum. 


(I;  3) 


‘<k>  H 

je<lc>-.  -J 


Each  variable  has  associated  with  it  a  variable 
fraction. 


(1.4) 


.<c.,  «  JlL 

J  :;r' 

'"<j> 


The  objective  function  to  be- miuiiiiized  is: 
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(1.5)  ,  x^)  5= 

The  c.^,,  C2,  .^.i  Cj^  are  given  real,  constants. 

When  X.  -  0,  either  *»  0  (if  x^jj^  >  0)  or  it.  is 
j  .a'-  ) 

undefined  (if  x^j>  “  0).  In  either  case.,  log  .x^  is:  under 
fined;;  but  to  maintain  the  continuity  of  F  at  the  boundary 
of  the  constraint  set  we  define  Xj  log.  «  0  whenever 
Xj  ■*  ([3i,  p.  .364‘) 

It  will  be  convenient  to  use  matrix  notation.  Thus 

♦•Vi 

-we  let  A  be  an  m  X  n  matrix  whose  ij —  element  is  a... 

ij 

That  is 


(i.6) 


1  X  n 

matrix  whose  ] 

% 

^12 

^In 

^21 

• 

« 

CM 

CM 

c« 

^2n 

« 

• 

ml 

• 

« 

^m2  *  •  • 

• 

^mn 

Similar lyj  we  let  b  be  the  mr-veptor  whose  i~  com¬ 
ponent  is  b^,  or: 


(X;7) 


^2  V 


In  .the  same  fashion  we  let  x  be  the  n-vector  v^ith- components 
Xj  ;  k  the  n-vector  witlv  components  ;  c  the  h-yector  with 
components  c^ ;  and  log  the  nrvectpf  with  components  log  f ^ . 

Using  vector  notation,  we  may  write  the  chemicai  equi¬ 
librium  problem^ in  the  following  compact  form: 

(1.8)  Min  F(x)  *  Min  x  •  (e  +  log  &) 

s .  t .  Ax  =  b. 

X,  >  0  . 

The  notation  x  *  (c  +  log  denotes  the  inner  product  of 
.the  vector's  x  and  (c  +  log  x). 

It  wibl  be  convenient  to  define  two  sets. 

(1.9)  ir(A,  b  =  ^x  >  0!>Ax  =  bi 

Clearly  this  is  the  set  of  ail  .feasible  points  x. 

(i.ro)  M(f1h)  's  ir.  e  H^F,(y)  >  F(x)  V  y  e  11} . 

Evidently,,  for  any  functipn,  F  defined  on  a  set  H,  the  set 
•M(fJh)  is  the  set  of  all  points  in,  II  where  F  achieves ,  its 
mimijnum.  In  particular,  if  we-  take  F  to  be  the  function 
defjhed  by  (,r.,5),,  (arid  H  =  '(H(A,  b)  from-  (T.9>),  then  M(FNi('A,  b^*t) 
is  the  set  of  points  x  which  are-  solutions  to  :thc  problem  (.1.8:).. 

"'A*  "• 

In  previous,  papers  '  we  have  explored  several  ways  in 
which  problem  (*.?8)  is  related  bo,  physical  phenomena.,,  and 
some  ifnathematical  difficulties  'assgeiated  with  solving;  it.. 

In  ‘this  paper  .wc'  will  discuss  several  methods  for  finding-  a 
Si'jiutiqn  to-  ^(.1 . 8)  . 

' '  Vf  '  ' 

"This  paper  is  the  third  in  a  series  of  three ^  The  first 
was  *'Ghe.mistry,  Kinetics.i  and  Thermodynamics^;'”  the  Second, 

"Degeneracy  ,in  ideal  Chemical  Equilibrium  Problems.” 
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II,;  PRIHM.  ML-Tlldb,S 

We  separate  methods  for  solving  the.  chendcal  equilibrium 
problem  into^  primal,  and  dual  methods,  acpording  to  whether  the 
the  purpose  of  an  iteration  of'  the^  method  is  to  find  an 
improved  composition  vector  (primal  methods)'  or  ;a  abetter 
vector  of  Lagrange  multipliers  (dual  methods).  In  an 
extension  of  Clasen's  terminoiogy  14,  5J,  the  methods 
would  be  called,  respectively;,  first~  and  second-order 
methods-. 

Furthe'r,  we  (Separate  primal  imethods  according  ito  whether 
the  set  of' variables  is  expanded  to  include  .the  x^^^'s  (the 
augiiiented  foriu,.  duo  to  Clasen  {'5]),.  or  whether  the  x^j^'s 
are  ignored  during,  each-  itoration,  and  updated  only  at  the 
end  of  the  iteration,  (the'  rcciuced  f dm,,  due  to)  the  author 
T  6  .  Both  forins  may  be  treated  as  spcicial  cases  of  a  more 

general  problem,  the  linear—logaritlimic  problem. 

The  first  primal  .mc:thod,  called  hero  the  Augment  od  L.lx^ear 
Approximation  Method,  was -developed  by -Clasrii  [.4,  5d  In  his 
workj  he  assumed  degeneracy  av/ay,  and  -failed  to-  present  any 
means  of  coping  with  it.  We  will  do  the  same  in  this  sec.- 
tion..  In  .Sections  III.  anct  IV  we-  will  deal  with  the-  problem, 
of  degenerar'y. 

1.  The  Augmented  J^orm 

The  form  in  which  the  chemical  equilibrium  problem 
was  originally  presented.,  (1.8)^,  is  to  find  a  vector  x 
satisfying: 

5: 

-  ■'-V.  .  tt  -  ...  i  -  ^ 


(I  I.  >1.1'-) 


Min  FCx)-  « 


s.t,  Ax;  =  <b 

X  >  0 

It  is  more  convenient however,  to  change  the  Jopn 
expanding' the  Gibb's  function,..  Remembering^  that 
it.  «  x./x^^.^-,  we  write: 


(il.1.2)  F(x),.  «  t  +  I05  ^  ^<i>* 

J  J  J  <j  >  -*  T 

If  we  include  <the  sums  x....  in  the  vector  of  variables, 

and  remember'  that'  Xj^/  we  may  .solve,  iri-  niace 

■*  'ke<j> 

of  (II,l'.i>i. 


■(  Mill;  F(x)  •=>  x.  Ocv  +  log'  x.)  -  E  x^.>log  x<.>) 
1  J  J;  J  <i>  J  “ 


(II. 1.3) 


s.t. 


Ax  ■»  h  ' 


<3> 

V<3> 


0  V  j  ,  <j>. 

If  there  are  n  species  and  p^  compartments,  there  will 
(be,  N  “  n  +  p  variables  in  problem  (.11.1.3).  Similar ly^i- 
if  the  equations  Ax  »  b.  are  m  in  number,,  then  there  will 
be  a  total  of  =M  «  m  +  p  equations  iii  the  constraint  set< 
of  (1 1. 1.3).  V/hen  the  chemical  equilibrium  problpm  has 
been  cast  in  the  form  of,  (Il.liS),  we  say-  is  in  augmented 
form. 


Notice  that  we  may  define  a  matrix  X,.  called  >the 
augmented  matrix,  in  such  a  way  that  it.  is  the  datache.rf 
coefficient  matrix  for  all  M  equati'ons  of  1.3),  A 
is  an  MxN  .matrix.  Define  3",  an  N-vector,  by: 


(II. 1.^) 


1  ^ 

S’.  =  ' 

J  M 


if  1  £  j  £  n 
if  -n  +  1  £  j  £  N 


Define  c,  an  N-vector,  by: 


(II. 1.5) 


1  £  j  £  n 


c.  -  ’ 

I  0  if  n  +  1  £  j,  £  N> 


Define’  an  M-vect6f  F  by: 


(11.1^6) 


I'  b ,  if  i  £  i  £  m 
I  0  i"f  m*  +  1  £  i  £  M. 


Augment  the  ve>.’.tpr  x  of  unknowns  by  letting,  x^  ibe 
the  appropriate  x^.^  for  a  -f  I  £  j  £  N.  Then  we  may  write 
(IT. 1.3)  as: 


(11.1.7) 


Min  T,  X  (c.  ^  F  log  X  ). 
j“I  ir  *'  J' 

s  .  t.  Sx  «  ‘F 

V  >  0. 


it  can  be  sliovm  (I;/)-,  Theorem  II.  1>  that  if  (11.1.7) 
.possesses  a  strictly  positive  solution  x*,  then  there  exist 
Lagrange  multipliers,  M  in  number ^  such  that  x*  also  sat¬ 
isfies  the  ICuhn-^Tucker  conditions  1 8]  for  problem  ;(,II.  L,.?;) . 
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2.  The  Reduce;  Aorm 

Suppose  the  original  problem  (1.8^),  possesses  at  least 

one  strictly  positive  optimal  solution  x*.  It  need  not  be 

unique.  ..For  each  j  ,  1  £  j'  <  n  we  define  new  values  for 

the  constantSi  c.  to  be; 

j 

(ai.2.1)  c|  =.  cj  -  1  -  log, 

Theorem  I I. 2.1;  Consider  the  following  two  problems; 

(11.2,2)  Min<  F(x)  =  Min  lbc.rc.  +  log 

3  3  J 

s.t.  Ax  «*  b 

X  >  0 

and  a  second  problem-, 

C,il.2,3')-  Mih  W(x)=  “ 'Miri  ^x.(c*  +  log  x. )' 

J*  '  “j.T 

s.t.  Ax  =  b 

X  b* 

where  ct  is  defined  by  (11.2.1)'*  and  x*  c  M(-fIh):-,  x*  >  0; 
Then' X*  is  the'  unique  solution  to  (11,2. 3) i 

F-rbbf !.  Fir'st,^  note  that  thq  function  g(t)  «  t  log  t  is 
strictly  convex  for  t  >  Oi  (We  define  g(0)  “  0  so  that  g, 
will  be  continuous  for  >t  >  0.)  To  see  this,,  note  that  for 
t  >  0,  g’ '  (t),  "  i  >  0.  As  the  sirai  of  a  linear  function^ 
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and  functions  such  as.  g(t).,  'W(x)  is  n  strictly  convex  func¬ 
tion  on  the  nonnegativc  orthant  pf  -n-spacc.  Therefore, 
(11.2.3)  has  at  most  a  single  solution. 

To  see  that  k-**  is  that  point,  we  look  at  the  Kuhn-. 
Tucker  optimality  conditions  <(;  8  ] .  There  must  exist  n*  such 


that 


Msii  -  =  0. 

^>^3  1 


i  5  j.  <  n 


(V?e  have  cquaiity  since  x’^  >  O'.  Were  one  of  the  =  0, 
we  would  replace  the  equality  by  >  O'.J  Evaluating  this , 
we  find  that  x*  is  the  solution  to  (11.2.3)  if  and  only 
if  for  some  fi* 


__  A-*-— '' 


cV  +  1  +■  log  x?  A.n  ,  1  <  j  <  ri. 

j  J  J  _  ><  — 

Substitute  for  cV  from,  equation  (11.2.1),  and  we  find  that: 

(1 1.2. 4)  c.  H*  log  ilt  =  aTti''^,  j  .5 

3'  3 

But  equations  (II. 2. 4)  ^constitute  the  ppti.mality  conditions 
for  (the  original  problem  (Tl.2.2).  Since  x"  solves  (II.2i2).,\  we- 
know  tha.t  the  rcq.ijiired  exists  ;QED, 

^*ifhen  the  problem,  has  been  put  in  the  form  (1, 1.2. 3) 
we  say  it  is  in  the  reduced  form.  The  chief  difficulty 

with  this  fonn  is  that  we  don’t  know  what  the  x. '('■'* s  will 

<3^ 

be.  in  the  course  of  using  this  forr.'i  in  computational 
methods  j  we  shall  use  instead  the  x^^y^'s  currently  avail¬ 
able.,  those  corresponding  to  bur  c.ufrent  solution; 
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3,  The  General.  Linear— Lofiaridumlc  Problem 

Clearl-y  ISoth  Che  augmented  aiid  reduced  forms  of  the 
chemical  equilibrium  problem  may  be  considered,  special 
cases  of  the  following  problem: 

MiivF(x)  =  S  (c.^  -I-  dj  log  x^) 

(11.5; 1)  s . t.  Ax  -  b 

X  >  0 

The  matrix  A  and  the  vectors  b,  c,  d  are  constant  quanti¬ 
ties*,  and  what  they  are,  as  well  as  .theii*  dimensions, 
depends  on  which  of  the  two  forms  we  choose  for  the-  problem. 
We  take  A  to  have  uLmcncion  M  x  N. 

Notice  that  unless  for  each  j:,,  d^  is  nonnegativc, 

F(,x)  is  not  convex.  It  may,  howeyer,  bo  convex  on  the 
domain  H(A,,  b),  where  d(A,  b)  =  'x  >  Ol  Ax  «  b''- ,  as  it  is 
in  either  the  augmented  or  :the  reduced  form  of  the  chemical 
equilibrium  problem. 


fl 


c 


o 


< 


4>  The  Litioar  Appro::imatloii  Method 

This  mothod  is  due  to  Clasen  l4,  5l. 

If  v;e  blindly  apply  the  Kuhn-Tuckcr  theorem  to  the- 
gcncrai  linear— logaritiinie  problem,  (II. 3.1).,  we  may 
believe  v/e  are  looking  for  a  vector  (x^,  tt*>  satisfying: 


(Ii.4.1) 


.r") 

J 


0, 


^TT. 

1 


i  =  0 


1  £  j  <  N,. 
1  <  i  <  M. 


where  >  0  only  if  =  0,  and  wher:e  : 

-'X.  ■  j 


(11. 4. 2) 


L(x,  tt)  -  F(x)  -  Tt'^(Ax  -  b). 


Performing  the  partial  dif Cerentiatioh  indicated  In 
(11.4.1),  we  find  that  (:<■,  it")  must  satis fyr- 


(11.4.3) 


(II. 4. 4) 


c.  -I-  d.  log  X? 
J  J  J 


d.  ^  .3^  tt",  v;ith  equality 
if  X?  >  0. 


Ax*'  =  b. 


S' 


lie  vdll  assume  that  x-^  >  0,  so  that  (IT.  4. 3)  is 

satisfied  as  an  equation  for  each  j.  Solving  ('Ii;4<.  3). 

for  log  we  find  that : 

■  J 


log  X*f  d7^  j  aT  rr'^  rr  c.  r  d.]  . 

J  J  j  J  J  J  I 


(11,4.5) 

Suppose  vv’c  are  given  a  starting  solution  y  satisfying 


o 


1  ^ 


Ay  ■=  b,  y  >  0.  We  may  expand  ahe  function  (log  x^ )  afdtind 
fhe  point  y^  in  a  Taylors  expansion.  Then: 

X.  -  y:: 

(II.4.6f)  log  x^-  «  log  y^  +  ^  ^  +  (higher-order  terms). 

Ignoring  the  higher-order  Gexms,  we  substitute 
.(II'.4.6),.  evaluated  at  xt%  into  (11.4.5);  Then: 

(II .'4. 7)  -  -- 


xj  .::x.  -  y.  d^ 


fr-'  -  c.  -  a  log  y- 
f  J>  J.  J  J 


To  find  the  value  of  the  right-hand  side  ojT  (II. 4. 7), 
we  must  first  evaluate  rr*,.  This  is  hot,  of  course,  po-ss-iblc, 
but  we  can  find  an  approximation  tt  to  tt*  by  substttut5.ng 
(li.4.7').  into  (II. 4. 4),  -as  is  done  belov^  io  (11.4.8). 

Let  p  be  a  diagonal  matrix  whose  jj---  '’...cnvent  is-  d^. 
Assume-  d^  #  0,  I  £  j  d  . 

Let  Y  be  a  diagonal  matrix  ^^lOse  jj— -  element  is  y^, 

1  <  J  <  N. 

From  (lii4.7J  we  write: 


(II. 4. 8)  b  =  Ax  (AYD“V^)7t  -  AYD"-^(c  -fc^d  log  y). 


1,. 


Define : 


(II-.4.=9,)  R«(AYD’V) 

Then 

(11.4'.  iO)  ‘RtT  '*5  be  +  AYD-  ^(c  4*  d  log  y) 
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In  the  reduced  case,  it  can  be  shovm  that  'R  is-  norh- 

singular  if  and  only  if  the  matrix  X,  obtained  from'  A  by 

deleting  those  columns  A.  with  y.  “  0,  has  full  rahlc -m. 

.  <3  J 

A  more  complex  comment  applies  to  the  matrix  R  obtained 
in  the  augriented  case.  Siurely>  if  R  is' nonsingular,  then 
equations  (II .4. 10)  possess  a  solution  tt. 

To  find  our  new  point:  x,  we  subscituce  tt  from  equation 
(H.4.10)  into-  (II<-.4.7)-  in  place  of  n*. 

Unfortunately,  we  cannot  insure  ti;)iat  the-  new  x  will 
be  positive,  and  so  v;e  cannot  in  general  use  x  as  our 
next  iterate.  Instead,  -V7e  use  a  vector  u  satisfying: 

(IIi/4.11)  u  =  ax  +  (1  -  a)y 

for  some  0  <  a  ^  1.  We  Insist  u  >  0, 

Section  11.6  will  give  ah  algoritlim  using  this  develop¬ 
ment,  and  an  indication  -pf  when  it.  might  work  and  wheil 


5.  .The  Quadra  l:j.c  Appro?:irnriti\on  Method 

To  circumvent  some  possible  convergence  difficulties 

of  Linear  methods,  -one  might  try  to,  insure;  that  the  new 
point  k  computed  from  y  could'  be  used  las  the  next  iterate. 
This  suggests  that  we  restrict  x  to  bes  nphhegative. 

The  "most  straightfor^-zardway  of  doing  this  is  to 
expand  F(x)  around  the  initial  solution  y  and  minL..l-:e 
the  second  degree  Taylor’s  approximation,  subject  to  xc 


constraints  Ax  =  b,  x  ^0.  In  place  of  probl  i  (11. 3; 1) 
we  solve  the  quadratic  prograi', lining  problem: 
d.  (x,  -y. 

Min  q(x)  =  4  —  -f  ^;(x^-yj)(c-.4djlog  +  Ky) 


3 


Ax  ='  b 


Since  ..?'.(x)  i.3  convex  on  H(A,  b)  ,  -Q(::)  will  also  be  convex 
Thus  a  vector  x  v/ill  solve  (Hi 5.1).  .if  and  only  if  it 
safis-fies  the  Kuhh-Tucker  optimality  conditions  isl. 

That  is.,  X  solves  (II.Sul,)  if  and  only  if  there  exists 
an  H-vector  rr  -nd  :aa  N- vector  5  such  that  fr,  6) 
satisfy^ 


;■  d ,  X . 

T' 

A .  tr  T  (  c .  +  'd . 

a  j  j. 

log 

1=  6. 

3 

i  <  j  <  N 

III. 5. 2)  ; 

j  Ax 

-  b 

=  0 

1 

[, 

■,x  >  O', 

i 

6  >  OV  k.6. 

-  ’  2  3 

t=  0. 
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6.  The  Basic  Algor Iblun 

The  Linear  Method  axid  the  Quadratic  Method  are  quite 
similar.  We  may  in  fact  write  that  the  new  point  x  found 
using  the  Linear  Method  must  satisfy: 


/  C.  •  -  m 

I  -  A.rr  +  Cc.  +  d.  log  y. 

y.  J  J  J  'j 

(11.6.1)  ^ 


Compare  these  equations  with  -equations  (TiI.S.^V  of  the 
quadratic  method.  In  tue  same  viay  as  for  (11.5.2)^.  sat¬ 
isfying  equations  (IT. -.6.1)  is-  equivalent  to  solving  a 
quadratic  program.  The  quadratic  prograti  to  solve  is  just: 


.(tl.6.2')  Min  Q(x)«U  -i-  g(>:^ -y^ (a.-i-d. log  y^-.-d  )  -t  f(y) 

L  J  ' 

S , t ,  Ax  =  b 


This  is  precisely  the  same  ct.  except  that  the 

solutiozi  X  is  not  constrained  to'  bC’  no-nnegative . 


Theorem  .~T. 6. 1.  Let  F(x)  be  convex  on  b).  let: 

y  >  0,  y  H(A.  b)  be  the  initial  solution  (either  in  tue 
Linear  or  the  quadratic,  method),  a.ul  lot  be  a  solution 
to  the  associated  quadratic  program  ((II. 5.1)  in  the  quad* 
r.atic  case,,  (II. 6. 2)  la  the  i.iaear  cas.' ) . 

Let  ^  -  X  -  y. 
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Denote  the  derivative  of  F  at  y  in  the  direction 


9"byF_(y)..  Then: 


F  Jy)  <  0 


with  equality  if  and  only  if  y  is  a  solution  to  -the  original 
problem  (II.3.1). 

Proof;  It  can  be  shown  that  since  y  >  0,, 

F^Xy)  =  +  dj-  log  Xj  + 

In  the  quadratic  case,  we  may  write  Cfrom  (II.5a.2));. 

^5(^4  *  y-'4 )  TT* 

(II. .6. 4)  — 1—  "  -  (c^.  *  "dj  log  yjj,  +  dj) 

In  the  linear  case,  we  have  from  (li.6.1)  that 
equation  (11.6.4),,  is  still,  true  with  6^  set  equal  to  2ero. 

Multiply  (II. -6. 4)  by  9^  and  sum  over  all  1  <  j  <' N. 
The,  result  is ; 


R'  , 


■'4 


(XL.  6..  5) 


d.  e?. 


^  y,6,  -  EiXy) 


since  in  both  the  linear  and  the  quadratic  methods, 
^  **  ^  linear  case,  because  6 «  0)  and 

since  AS  =  0,. 


The  left-hand  (Side  of  (11.6.5)  is  just;; 

,2 

( II  .  6  .;6)  r.'  ~  4^7-  F.(y  +  1 9 )  I-  >  0 

dt-  t-0 
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which  is  ndnnegative  because  F  is  convex  oh  H(A,b)..  thus.: 

d,  0^  ' 

-y.  «  V  i(Quadratic) 


(11.6.7).  ■  Fj(y) 


d.  6? 


<  0' 


-■’n; 


y 


j 


(Linear) 


If  y  is.  not  an  optimal,  solution  ,of  (11. 3.1),,  theh> 
there  exists  y*  e  H(A;,b)  such  that  F(y*)  F(y)*  Let:. 


«=  y*  -  y. 


Since  F'is  convex  oh  H'(A,b) ,  clearly: 


F',v(y)  <  0- 


■O' 

If  we'  let  x(ci)  »  y  +  a0*  tor  some  0  <  a  <  1^  then  x(qc)  e  HCA,;  b) 
-Further, 

2'  d.  (6*)^ 

(II. 6. 8)  Q(x(a))=  -  ^  4-^;^ —  -+<1^ 

Since  F  is  convex  on  H(A,b),  surely  Q(x(a))  is  a  convex 
function  of  a,  an^ 


§la.O  “  O' 


Thus  for  some  a  >  0, 

(11,6.9)  Q(x(a))  <  Q(x(0))  »  Q(y)  “  F(y). 

That  is,i  if  y  is  not  an  optimal  solution,  to  (II. 3.1), 
then  .the,  solution  x°  to  (II. 5.1)  or  (il.6.2)  satisfies: 
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(Ii.6.10) 


Q(x°>  <  Q(y)  *  F(y) 


Now  suppose  X 


®  is  a  solution  to  (II. 6. 2) 


and  “  x^  "  y*  -Further,  let  t 
Fj(y)i  “  0. 


d,,(x?  "  yi)^ 

From.  (II. .6, 7)  we  isee  that  r.  J  -V''  ■  “  Substituting. 

■'j 

this  i.nto  'Q(x°) ,  we  have': 

< IF. 6. 11)  Q'(X°)/  “  '2  ^  -  y,:  ^  yj+dj)+I(y) 

=  0  +  F’(y)  +  F(y)  “  FCy). 

That  is,  FqXV)  “  0  implies  Q(x^')  =  F(y).  But  <we  showed: 
that  this  in  turn  impltG.s  that  y  sblves  ('II.3. 1). 

QED, 

The  algoritlxn  based  on  either  of  these  methods  may 
be  stated  as  follows: 

1.  Given  y  >  0,.  y  R  H('A,b),  find  (x,tt)  satisfying 
(II. 5. 3)  in  th.’  quadratic  case-,  or  (11.6. 1-)-  in 
the  linear  case.  Let  6  "‘X— ,y. 


2.  If.  s  -J-JL-  +  (^'  “0  in  the  linear  case) 

y  j  j  3  3 

I'S  sufficiently  stfiaH.,  terminate.  If  not,  go 
to,  step  3. 


3,  Let  u,  =  y  +  dft;  for  some  0  <  Ihe  vector 

,u  must  satisfy  u  >  0  and  F(u)  <  F-(y).', 
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4.  Replace  y  by  u  in  step  1,  and  continue  the  cycle- 
from  there. 


The  termination  criterion  of  step  2  does  not,  say  how 

small  T  +  y,  6.y,  must  be.  This  is  a  matter  to  be 

yj, 


decided  by  the  requirements  of  the  problem-. 

Combining  the  two  forms  of  the  chemical  equilibrium 
problerii,.  augmented  and  reduced,  with  the  tv;6  methods'  of 


solving,  the  linear-logarithmic  problem,  linear  and 
quadratic.,  yields  four  different  methods  for  solving,,  or 
at  least  trying  to  solve,  the  chemical  equilibrium  problem. 
We  name  these  methods  the  Augmented  Linear  Method  (ALH) , 
the.  Augmented  Quadratic  Method.  (AQM),  the  Reduce..  Linear 
Method  (RI.iM),  and  the  Reduced ’Quadratic  Method  (ilQM) . 

Reduced  methods  hav..e  the  advantage  that  the  number 
of  variables,  and  hence  the  size-bf  the  problem,  is 
■smaller  in  the  reduced  case  than  in  the  augmexitcd.  Linear 
methods  hold  an  advantage  over  quadratic  method's  in  that 
each  iteration  requires  less  time,  or  at  least  no-  more 
time.  That  is^,  the  finding  of  a  new  direction  in  a  linear 
method  is  never  a  more  .lengthy  process,  and  is  sometimes 
a  shorter  one,  than  in  a  quadratic  method,  .Ifnethcr  this 
advantage  is  dounterbalahced  by  a.  possible  saving  in-  the 
number  of  iterations  required  by  the  quadrsacic  methods, 
the  author  cannot  say. 


The  linear  methods,  however,  need  not  converge  to 

a  solution  y*  of  (11.3.1).  If  (11.3.1)  has  a  bounded 

solution  set,  it  can  be  shown  that  the  sequence  of  iterates 

generated  by  the  method  has  a  limit  point.  But  it 

(may  happen  that  the  successive  step  sizes  converge  to 

d.  f)? 

zero,  allowing  the  quantity  ^  .  J:  ^to^  remain  bounded  away 
from  zero.  This  might  occur  ify.  for  example,  one  of  the 
limit  points;  y°  of  has  spine  component  y^  -  .0. 

With  somtf.  modifications.,  it  can  be  shown  (and  will 
be  shown)  thr’t  the  quadratic  method  applied  either  to  the 
reduced'  or  thv-:  augmented  form  yields  a  solution  :tO'  a 
slightl'y  modified'  problem. 

The  author  recommends  that  whatever  primal  method 
is  used,  islacks  be  included  in.  the  formulation  (see  [7]). 

To  includd  slacks-  in  the‘. problem  is  equivalent  to  including 
in  py.ph  compartment  a,  tiny  amount  of  a  suhstahee  that,  will 
net  diffuse  to  .any  other  compartment  and  will  hot  partici¬ 
pate  in  any  reaction.  This  can  be  done  by  replacing 

by  y<i>.  +  s^,^,  and  by-  - wherever  they  occur  in 

3  3  3  y<j^’<j> 

the  formulas,  where  each  s<j,>  is  some  small  positive  number. 
This  will  insui-e  that  if  an,  answer  -exists,  it  will  ’be 
uni'que,  and  so  that  if  a  srjlution  method  generates  a 
-sequence  of  iterates  with  some  as  a  limit  point, 

and  if  -  M(f|h),,  then  the  entire  sequence 
converges  to  y*. 
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III.  A.CT.qSKR  I^OOK  AT  THE  REDUCED  QUADRATIC  METHOD 

This  section  deals  with  a  method,  first  proposed  by 
the  .author  in  16  ]  ,  for  solving  the  chemical  equilibrituri 
problem,”  Because' -of  its  derivation,,  dhe  might  call  it 
the  Reduced  Generalized  Linear  Programming  Method.  Hbw-r 
ever,  it  turns  out  in  the  end'  to  be  the  same  -as  RQM,  We 
retain  the  derivation,  even  though  it  lea4s  to  nothing 
new,  because-  it  is  both  interesting  in  its  own  right  and 
because  it  leads  us  to  suspect  that  RQM  might  be  more 
;pow.§rful  than  supposed. 

1 . ..  The  Reduced  Generalized  .LinearJProgram 

If  the  objective  function  of  a  chemical  equilibrium 
problem  were  linear,  would  have  a  ready-made,  effidient 
.method  for  solving  ^the  problem,  the  simplex  method..  Since 
it  is  hot  linear,  we  try  to  make  it  so.  We  will  find  it 
convenient  to  use  the  reduced  form  (11.2,3)  in  place  of 
the.  original  form  (TL. 2.2). 

Instead  of  solving  (II. 2. 3-)  directly j  let  us  "linearize 


it  by  intrpdu.cing  n  new  variables  , 

1  £  j  5  solving 

the-  problem: 

(Ill.l.i)  Min.  ^(y,a)  =  Min  y.  y-j  (9j  " 

log  a^) 

s.t'..  Ay  =  b 

1  1. 

y  >  0 
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Each 


ttj  may  be  chosen  independently  of  every  yj^. 
Clearly^  given  any  y  e  H(A,b) ,  we  can  find  a  cprre 


spending  feasible  solution  (y,<^)  to  (III, 1.1)  by  choosing; 


(  1/y.  if  7:;  >  0 

a.  =  '  1  <  j  <  n. 

^  |l  ify^  =  0 

Alternatively,  given  a  feasible  solution  (y,  a)  to  1.1), 

the  vector  y  is  a  feasible  solution  to  the  original  problem 
(1T.2...3)  —  i.e.,  y  e  H(A,b). 

Further,  if  (y,  a)  is  a  feasible  solution  to  (111.1.1'), 
it  may  easily  be  improved  unless 


(III. 1.2).  y^a.  =  1  Vj  y^  >  0. 

We  may  consider  (111.1.1)  to  be  a  generalized  linear 
program  ([ll],  p.  434).  Thus  we  wish  to  minimize  a  linear 
form  subject  to  linear  constraints,  where  the  vector  of 
coefficients  of  a  variable  y^  is  not  constant,;  but  rather 
can  vary  over  some  set.. 

The  quantities  v  and  (-Xj)  appearing  to  the  right  of 
the  eons  train  ts  of  (III. 1.1)  are  Lagrange,  multipliers 
The  multipliers  n  corresponding  to  equality  constraint.? 
are  unrestricted  in  sign,  but  the  multipliers  (“^j) 
corresponding  to  inequalities  must  satisfy; 

(Tli.1.3.)  ^ j  -  ^  f  <  J  5  h. 

Suppose  we  have  an  initial,  feasible  solution  (y,  a) 
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to  '(HI. 1.1)  which  is  strictly  positive.  Let  (III. 1.2) 
be  satisfied  for  each  j . 

Consider  the  as  constants.  For  the  given  , 
assume  that  the  solution  y  is  the  optimal  solution'  to 
(HI.  1.1).  (This  will  surely  be  the  case  if  H(A,  b)  is 
bounded.,  The  reader  may  easily  check  that  in  this  case 
y  is  the  only  solution.)  Under  this  assumption  there 
,must  exist  multipliers  (n,  x)‘  such  that  (y,  b,  >:)  satis£i..-s 
the  -Kuhn-Tucker  cohditioris  [ 8  namely: 


(III. 1.4)  f.(ap 


log  Oj 


aTtt  +  d.x.  =0  1  <  j,  <  n 

J  J  J  . 


To  improve  the  solution  (y,  a),  we  must  find  new 

columns  of  coefficients  from  the  s.ets-  mentioned  <before 

which  .it  would’ be  profitable  to  intr.oduco--i.c. ,  which 

"price  out"  negatively,  That  is,  we  must  find  new  values 

d.‘  for  the  variables  a.  satisfying; 

J  3 

(iii.i.5^).'  ^'  £  j  £  "> 


with  strict  inequality  fpr  at  least  one  j . 

The  function  f.(a.,)  is  defined  for  a.  >  0  and  is  conver: 
3  J  J 

a  fact  easy  to  check.  To  satisfy  (III.  1.5)  we  v.'ould  b.' 

well-advised  to  minimize  the  function  r,,  subject  to  a.  >  0. 

3  3 

The  minimum  occurs  where  the  derivative  vanishes. 


(-III. 1.6) 


df. 


^  .0  -  -  -  ,  +  X  , 


If  X.  >  0,  V7e  should  therefore  choose  a'  «  ~  .  We 

•i  I  ^  • 

3 
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wiH  deal  with  the  .case  that  »  0  later  . 

We  have  so  far  only  asserted  the  existence  of  multi¬ 
pliers  (n,  x).  Conditions  (111.1,3-4)'  are  in  general 
too  few  in  number  to  determine  their  values.  But  equations 
(ill-.,  1.6)  suggest  that  the  multipliers  x^  be  interpreted  as 
‘Composition  variables.  Thus  we  demand  that  x  e  H(A,  b). 

Thi's  latest  condition,  with'  (111,1,4)  requires  that 
(n,  x)  satisfy  (substituting  ~  for  and  Cj  -  1  log  y<j,> 
for  o|)':  ^  . 

/X  • 

y  "*  “  3.)  «  0  i  <  j  £  n 

(in.  1.7)  Ax  -b  -‘0 


X  >  0 

We  have  gone  from  one  .extreme  to  another.  The 
equations  of .  (III  .  1. 7)  are  those  of  the  Reduced  Linear, 
Method,  it  can  be  shown  that  if  the -matrix  A  has  full 
rank  ther"  is  a  unique  solution  x.  to  these  equations. 
However,  this  solution  need  not  be  nonnegative. 

To  insure  that  x  >  0,  we  relax  the  first .n  equations 
as  follows: 


I  “  AjTT  +  (Cj  +  log  -  1) 
(III. 1.8)  ;  Ax  -  b 


-C 


V 


V  ,  ' 


We  find  that  the  reduced  generalised  L.  P..  method  leads 
back  to  the  Reduced  Quadratic  Method. 

This  suggests,  however,,  that  as  in  a  generalized 
L.  P.,  the  new  solution  k  will  itself  be  strictly  better 
than  the  old.  in  fact,  this  is  the  case. 

To  prove  our  theorem,  we  will  need  the  follbwingv 
lemma. 

Lemma  III.  1.1.  Let  g(r)  »  r  ~  1  ~  log  r  be  uefincd  for 
r  ^  0,.  with  g:(0)  -  '<•.  Thexi  g(r)  >  0  for  all  r,  and'  g(r)  “ 
if  and  only  if  r  »  1 

Proof:  .It  is  well  known  that  g(r)  is  strictly  covex 
in  r,  and  differentiable  for  r  >  0.  Its  minimum  occurs 
where  the  derivative  vanishes .,  Thus : 

(III.l.?,)  g'(r)-l-|»0 

implies  ,  the  minimum  occurs  at  r.  «  1,  od  nowhere  else  ’(by 
strict  convexity)*."-  Substituting,  we  find  for  each  r  ^;0, 

(III.  1.10)  3g(r)  g(l)  «  1  -  1  -  l^g  1  «  0 

with  equality  if  and  only  if  r  «  li 

QED. 

Theorem. 111.1.2.  Let  y  e  H(A,  b),  y  >  0  be  an  initial, 
point,  and  let.  (x,  tt,  6),  satisfy  (1II.1.8).  Define 
fl X  -  y,  and  u(a)  -  y  +  q9.  Then: 

(t)  F(u(a)>  <  PCy)  Vp,<a<l 
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and: 


(ii)  F(u(d)).  «=•  F(y)  if  and  only  if  either  a  »  0 
or  y  is  a  solution  to  the  'original  prohlom 
(1.8)  (or  li.2,2).  In  this  case,  x  =  y. 

In  this  theorem,  F  refers  to  the  original  Gibbs  function, 
not  the  objective  of  the  linear rlogaritlmiic  problem. 

Proof:  X  satisfies: 


(III. 1. II) 


^  -  A^tt  +  (Cj  +  log  ^ 


where  6^^  >  0  and  x^S^  =  0  for  1  <  j  <  n.  Multiply  (JII.1.11) 
’oy  (y^  -  Uj(<i))  and  sum  over  1  £  j  <  n.  After  rearranging 
terms-  this  gives  us: 


(111,1.12)  F(y)  -  F(u(a))  «  a  ^6.,y.  +  y..  u.‘(-i  -  I  ~  log  — 1. 

j  J  J  y  3\yj  y^) 


+  a(l  -  a)  t:  -i  . 

'  .  y. 

J  -3 

Equation  '(illil.l2),  holds  for' all  0  <  a  <  1, 
Taking,  the  right-hand  side  of  (111.1,12)  term  by 
term,'  we  see  that: 


(in.1.13) 


a  f:  6,y.  >  O' 

j  J  ^  :■ 


(III.1.14)  y  u  —  -  1  -  log  ^  ^  g  j\  ^  ,0 

J  -’VJ  V  .  J  ^  ViJ^ 


where  g  is  defined  in  henmta  ill.  1.1. 


(III.1.15)  -  log 

<J>  ^  \^<3> 

r,  u  g/lm'\  >  Ov 

<i>  \u._.J 


This  term  must  be  modified  if  a  =  1.  For  a  <  1,  note  that 
u^.^(ct,)  ">  0  for  every  phase  <j>,.  But  at  ^  =  1,  u  =>  x,  and 
some  x^^>,tnay  be  zero.  Thus  we  write  (III. 1. 15),  for 
a  «  1,  as: 

(111.1.16)  ^  ■(  y<,5  -  log  >  0  If  a.  =  1 

■i)>\  ^  ^  ^  ='<W 


For  each  <j>  .such  that  >  0,  this  is  the  same  as  for 

a  <  .1.  if  X  =0,  then  the  only  nonzero  ;term  of  the 
J 

•sum  (111,4 1.16;)  equals  y<j>  ^  P- 
•Finally, 


(III.  1.17)  - 


q(l  -  a)  F  ^  0. 

j 


Combining  (III, l.iSrl?!  we  have: 

(I'IX.4.18,)  F(y),  -  F(u(a))  >0  0  f  a  <  1 

proving  statement  (i). 

To  shov7  statement'  (ii),  note  that  if  a  =  0,  then 
®  y>  so  that  surely  F(u(a))  »  .F(y), 

Suppose,  on  the  other  hand,  that  o  >  0,  and  F(a((i)) 
We  first  take  ct  «  1.  From  (III;.  1 , 14”)  we  see  that 
F(y)  —  F(x)  =»  0  only  if  for  each  j, 
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r  ^ 

r 


if- 


E  1 


^  : 


(HI,  1.19) 


-which, 


■  K. 

x.  g(^) 

J  I* 


0 


is  true  if  and  only  if  either  =  0,  or  k^.  «  y^.,  by 
Lemma  III. '2.1,  If  ft  ^  0^  then  for  at  least  one  j,  =  -O'. 

But  this  implies  that  9^  y<j>*  ^^c:nce'  the  inequali¬ 

ties  ( III i 1.15)  or  (III. 1.16)  apply,  proving  that: 


(III. 1.20) 


F(x)  <  F(yV  if  X  7^  y. 


For  0  <  a  <1,  v/e  need  only  note  that  F  is  convex,  so 
that,  for  every  a,  ,0  ■<  a  <  .1,  F(u(a))  <  F(y)  if  x  y, 
We-have  shown  that  FCu(a);)  «  F(y);  if,  and  only  if 
d  «  0  of  X  =  y.  To  complete  the  proof,  we  must  shov;  that 
in  the  latter  case,  y  solves  (I.8,)'. 

But  if  X  =  y,  then  0  =  0,.  so  that  Fp(y)  *=  0.  Thus  by 
Theorem  11.4,1,  y  solves  the  original  problem.  QED. 
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2 .  Lov/er  Bounds 


V,e  may  separate  feasible  solutions  y  into  "bad"  points 
and  "‘good"  ^points .  "Bad"  points  arc  , points  y  e  H(A,  b ) 
which  are  not  interior  to  the  nonnegativc  orthant. 
other  feasible  points  are  "good". 

The  reason  for  this  terminology,  particularly  with 
regard  to  RQM,  is  easy  to  see  upon  examining  equations 
(III.  1.8).  If  we  have  as  our  initial  point  y  a  "bad" 
point,  and  we  try  to- generate  a  new  point  x  from  it,  then 
X  must  satisfy: 

(HI. 2.1)  ^  -  A^n  +  (cj  1  log  Yj  -  <  .3  1  "• 

if  y^  “0,  this  is  undefined.  Large  values  of  y^  present 
their  o\<m  difficulties.  Similar  reasoning  poijitrs  out  that 
bad  points  are  bad  for  any  of  our  primal  methods. 

As‘  it  happens,  the  only  "bad"  points  that  ordinarily 
concern  us  are  those  satisfying  y^  =  0  for  some  j .  This 
is  a  consequence  of  the  following  result. 

Lemma  III. 2.1:  Let  y  c  H(A,.  b),  and  define: 

(HI. 2. 2)  S:(y^  =  {x  e  H(A,  b‘)lF(x)  ^F(y)}. 

Then  S(y)  is  bounded  if  and  only  if  the  solution  set  M(FiH') 
of  the  original  problem  (11.2.2)  is  bounded  and  non-empty. 
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Proof;  We  know  that  since  F  is  convex,  S(y);  must  be  cohvexi 
If  S'(y)  is  unbounded j  then  by  a  wellrkriown  result  (see,  for 
example,  [12],  Lemma  3,>,  there  exists  a  vector  v  9^  0  such 
that  for  all  x  e  S(y)  and  all  't  >  0, 

(111. 2. 3)  X  +  tv  e  S(y). 

Notice  that  this  implies  in  particular,  since 
X  +  tv  e  II(A,  b),  that': 

(111. 2. 4)  Av  =  0 

V  >  0. 

Furthermore,  for  every  t  >  0, 

F(y  +  tv)  <  F(y>, 

By  the  homogeneity  of  F 

F(v  i  y)  -  F(i  y)  <  0. 

Letting  t  -  V7e  haycj  since  F(0)  ?=  Q  ^I'ad  F  is  continuous-, 

(111,2.5)  F(v)  <  a. 

3y  [l2j,  Theorems  4  and  5,  it  is  implied  by  Equations 
(III. 2. 4-5)  that  M(f1h)'  is  either  unbounded  or  empty. 

Conversely,  it  is  clear  that  M(f1h)  c  S(y).  (This 
docs  not  rule  but  the  chance  that  M(f1h)  is-£empty.)  Thus 
instead  of  solving  the  original  problem  (11.2.2),  vjc  could 
replace  it  with : 
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Hin  F(x) 
s.t.  X  e  S(y). 

If  S(y’)  is  bounded,  then  it  is  compact  (since  by  the  con¬ 
tinuity  of  F  i"  must  be  closed).  And  a  continuous  function 
always  achieves  its  minimum  on  a  compact  set.  Thus 
M(Fis(y),)  is  nonempty,  and  (since  S(y)  is  bounded)  M(FiS(y)) 
is  also  bounded. 

Clearly,  M(F|'S(y))  =  M(f1h)..  QED. 


The  set  S,(y)  has  for  us  the  significance  that  if  v.’c 
begin  the  algorithm  at  an  initial  point  y'^^^  ^  b),  '• 

then  every  iterate  y^^"^  must  also  be  in  the  set  S(y''''^'). 

If  M(f!,H)  were  bounded  and  nonempty, j  then  the  sequence  of 
iterates  {’y'‘‘'}  generated  by  Any  of  the  primal  algorithms 
•x>i'ould,  be  a  bounded  set. 

Furthermore,  even  if  M(f|h)  is  either  empty  or  unbounded, 
we  may  continue  generating  new  points  until  some  yP^^  grows 
too  large  to  be  handled.  This  will  m.crely  be  evidence  jthat 
the  solution  we  are  chasing  is  a  v7ill-o-therwisp.  In  addi¬ 
tion,  we  may  rule  out  the  possibility  that  M(f!.H)  is  unbounded 
by  introducing  slacks  into  the  problem,  as  suggested  in 
l  /]. 

On  the  other  hand,  that  some  ”  0  does  not  sug¬ 

gest  that  the  problem  is  without  a  solution.  More  than  this.. 

(k) 


in  a  practical  sense  y, 


need  not  actually  be  zero  to  cause 


trouble;  it  need  only  be  sufficiently  small  that  the  electronic 
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computer  cannot  work  with  it.  We  must  ilave  some  means  to 

(k) 

insure  that  ho  iteration  has  a  component  ■'  Coo  close  to 
zero. 

The  obvious  way  to  accomplish  this  is  to  modify  the 
problem  by  placing  lower  bounds  on  each  variable.  Thus  we 
might  solve: 

(111.2.6)  Min  F(x)  «  T.  x^(Cj  +  log  ^  ) 

s .  t .  Ax  ==  b 

X  >  >(-  >  0 


where  -f  is  an  n-vector  of  lower  bounds,  each  1  5  j  <  0, 
being  a  small;,  positive  number. 

By  expanding  the  number  of,  variables  and  the  number 
of  linear  constraints,  we  may  cast  (111.2,6)  into  the  form 
of  a  classical  chemical  equilibrium  problem., 

(111.2.7)  Min  .F(x)  =  t  (c^  +  log  Xy)  +  t  s^  +  log 

s . t .  Ax  =  b 

"^3  j  i 

X  >  0,  s  ^  0, 

Each  variable  s.  is  taken  to  be  in  a  new  compartment,  and. 
is  the  only  species,  there.  Its  free.rehergy  constant  c.  , 

3’Tn 

is  set  to  zero. 

It  is  not  necessary,  however,  to  expand  the  problem 
in  this  way.  Lower  bounds  can  be  included  without  increasing 
the  size  of  the  problem  at  all.  For  the  RQM,  in  place  of 
equations  (III.  1.8),,  we  would  let: 


<  to 


(III. 2. 8) 


X 


X  = 


and  require  x'  to  satisfy; 


'(111.2.9) 


:  1 


-A 


T  ) 

1  t 


L'i 


i  ■  -a'T  : 


X 


n 


in 


jc^  +  log  -  1  +  ; 


+ 


Yi 


Yu  ~ 


Vi 


-  b 


1  • 


a,  .  ^ 
Ij  J 


"  b„.  +  ”  a  .  /  ; 

-I  roj  j 


J; 


n 


x'  >  Oi  6.  >  0,  6.  •  x!  «  0,  1  <  i  <  n. 

J“  3—  J  J  »  — 

It  is  easy  to  show  that  if  x;'‘  satisfies  (III. 2. 9;),  then 
X  =  x'  +  (from  (111.2,8))  solves  the  quadratic  prograrr 
(,IL.5.1)  for  the  reduced  quadratic  case,  with  the  non*: 


negativity  conditions  x  >  0  replaced  by  >:  >  n .  It  is  also 
eaay  to  show  that  (x,  s)  will  be  the  point  generated  by 
RQM  applied  to  the  expanded  problem  (III. 2. 7),  v/here 
s  =  x'  =  X  -  ^  are  fhe  new  values  for  the  additional 
variables. 

This  observation  insures  that  all  the  theorems  that 
have  been  proven  for  the  problem  'without  lower  bounds 
still  , are  true  for  the  problerri  with  lower  bounds. 
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2_  TK»  Modified  ROM  AlgotigSi 

The  algorleta  for  the  RQM  may  be  modified  as  a  result 

of  Theorem  111.1.2,  and  to  include  lower  bounds .  These ^ 
two  modifications,. as  we  shall  see,  insure  that  the  algorithm 
will  yield  a  solution  y*  which  is  optimal  for  the  lower - 
bounded  problem  (111.2.7) 

1.  Given  y  >  t,  y  s  H(A.  b).  solve  (111.2.9.) 
for  x' ,  and  let  x  =  x'  +  We  -may  use 
complimentary  pivot  methods,  or  we  may  choose 
to  solve  this  as  a  quadratic  program. 

2.  Let  «  K  -  y.  If 

sufficiently  small,'  terminate.  If  not,  go  to 
step  3. 

3.  Let  a  and  be  prechosen  numbers.  Pick  as 

a  stop  size  any  a  satisfying. 

0<a<q<a<l. 

That  isr,  we  bound  n  away  from  zero  and  if  v/e 
wish,  from  one.  A  perfectly  adequate  choice 
is  a  =  q,  and  hence  a  coaistant  step  size. 

4.  Let  u  -  y  +  aO.  Replace  y  by  u,  and 

return  to  step  1. 

The  convergence  criterion  of  s.tcp  2  has  been  modified 
to  take  account  of  the  lower  bounds. 
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VAiaf  follows  is  a  proof  that  the  algorithm,,  finds  a 
solution  to  (I1I.2.7).  Throughout,  we  v/ill  use  the 
following  notation: 

is  the  sequence  of  iterates  generated 


by  the  modified  aigorit^'mn. 

is  the  sequence  such  tl\at  x(k)— L  satisfies 

(III. 2. 9)  if  y  is  replaced  by  y^'^^ . 

,(k)  (k)  (k)  ^  ,  , 

o'  ^  -  y'  ^  for  each  k. 

is  the  k^"  step  size,  satisfying  0  <  ^  ^ 

for  all  k,  so  that: 


y(k+l)  ,  y(k)  ,(k) 

iC 


We  will  also  assume  that  the  solution  set  H^(f!k)  of  (II. 2. 7) 
is  bounded  and  nonempty.  The  "subscript"  A  denotes  lov/er 
bounding.  It  is  easy  to  show,  using  [12].,  Theorems  h  &  5,  th 
M^(FIH)  is  bounded  and  nonempty  if  and  only  if  M(FiH), 
the  solution  set  of  the  non-iower-bounded  problem,  is 
bounded  and  nonempty. 


Lemma, I 11.3.1;  lim  =  0. 

k-?’’ 

Fro^:.  Since  M.^(f!h)  is  nonempty,  F(x)  is  bounded  below 
on.  H^(A,  b)  =  tx  >  / IAx  =  b‘.  Thus  the  monotone  decreasing 
sequence  CF(y^^'^  )  •  must  have  a  limit.. 


Using  the  function  g  from  Leiruua  IlT.i.i  and  equation? 
(III. 1.12-17)  from  Theorem  III. 1.2,  we  have  that: 

(III. 3.1)  F(y<'‘>)  _  F(y<>^+1>)  >  S  y  (k+1)  ^  0_ 

“  j  ^  -  ■ 
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Substituting  for  and  tak.5.ng  the  limit  as  k  -  ■»,  v?o  find 
that  for  each  1  <  j  £  n,  by  Lemma  III.  1.1,  -| 


(III. 3. 2)  lim  y. 


>,""1 


Since  for  every  k,  y.  '  ^  t-  >0,  we  see  'that  b,y 

3  3 


Lenmia  III.  1.1, 


lim  — i— 

k-*eo  y  . 

•^3 


(k-f-1) 


y/k-l)-y.W  j.0<) 

(III. 3. 3)  lii'.i  —3 - rrrr-^^^ -  “i  —’Vrr  “ 

^3  ^3 

But  e  S(y^^^),  a  bounded  set,  and  the  we  uniformly 

bounded  away  from  zero  by  a.  The  conclusion  follows. 

Q.E .D. 

Notice  chat  since  H^(f|h)  is  bounded  and  nonempty, 
S(y*'^^)  is  bounded..  Thus  the  set  of  iterates  }  is'  a 

bounded,  infinite  set,  and  hence  must  have  a  limit  point. 

Theorem  III. 3. 2:  Let  N  be  a  subsequence  of  integers 

(1,  2,  .,,)  such  that  converges.,  and  let: 


(III„3.4  ) 


y'^  «  lim 
.  keN  ‘ 


Assimie  there  exists  v  >  -^  .such  chat  Av  =  b,  and  suppose 
the  matrix  A  has  full  rank  m.  Then, 
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V 


[?  : 


if- 


I- 


I  ; 


If 


I' 


^  y'^  c  M^  (FIh). 

Note:  It  is  no  hardship  to  assume  the  existence  of  v  >  t 

such  that:  Av  =  b.  .The  appendix  shows  a  method  for  finding 

(O') 

an  initial,  strictly  positive  ^olecion  /  '■  ,  if  oiu; 

(O') 

We  may  always  set  the  lower  bounds  to  satisfy  y  ■  >  {. 
Proof:  Surely  y*  is  fcas.Lble.  That  is,  y'"  >  I  and  Ay  “  b 


From  (III. 2. 9)  ve  write  that 
(I.tl.3.,5)  C  +  log  -■  il— 

J  J  J  -J*  V  , 


y(^)  , 


Since  yP^^  >  l.  >  0,  and  s  S(y^^^)  (a  bounded 

s  3 


se's)  implies  th<at  y.<A>  bounded,  we  have: 


(III  .,3:.  6)  y 


>?'  •>  h  »  iix  >  0. 

y<j>  ws  J 


1  .. 


<  j  <  n. 


Partition  the  indices  into  two  sets,  X  =  (j  iy'"  " 

.1  3 

J  =  {jly'.'  >  t-  }j  and  let  v  >  A,  Av  ~  b.  Define  a  reaction 
3  3 

vector  r  by; 


(III. 3. 7) 


=  V  -  y 


Clearly,  >  0  for  j  e  I. 

Multiply  each  equation  j  of  (III. 3. 5)  by  and  sum 
over  1  £  j  <  d.  The  result  is: 
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i 


(k)  (k)\ 

(III.3.8)  .  rj(c.  t  log  .^<W)  -  .  .f)  *  . 


Notice  that  for  j  e  J,  we  must  have  for  k  c  N  suf¬ 
ficiently  large  that  >  -t. ,  and  since  for  each  j , 

/I  \  J  J 


(k) 

.  '  -«  0,  we  will  also  have,  for  k  c  N  sufficiently  large  and.  j  e  J, 


>  ly.  But  from  (III. 2. 8)  and  (III. 2 *9)  we  see  that 


for  every  k, 
(111,3.9) 


«  0. 


Thus  for  k  6  N  large  enough  and  j  e  J  we  have  6  -  0,, 

J 

SO  we  can  vnrite: 


,('H> 


(III. 3. 10)  liiri  ft)*'-'  -»  0  -j,  €  J. 

kcN  ^ 

From  hemma  III.3ii  we  have  that; 


(III o 3 ,11)  lim  S  r. 

keN  j 


.(k)..  (k)’ 

'j 


0. 


And  from  (III. 3. 6)  we  know  that  there  exists  a  bound' B 
such  that  for  every  k  «  1,  2,  ..., 

(Ill, 3,12)  Urn  I  r,  (c.  +  log  5)-$^^)  £  B. 

keN  J  J  3  3 

Take  the  limit  of  each  side  of  (111.3,8)  and,  using 
(IIIo3o 10-12)  wc  find  that; 


(111.3,13) 


lim  E  r,  <_  B. 

keN  j  cl  3  J 
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But  for  each  1  e  I  we  have  r.  >0,  and  certainly  each 
g(k)  >0.  Thus  for  each  j  e  I,  the  sequence 

a  bourfded  sequence,  and  must  have  a  limit  point.  Let 

be  a  subsequence  of  N  such  that  for  each  j  e  I  the  sequence 

{ 5  converges  .  Let : 


(III. 3.14) 


f>*  «  lim  6^^^ 
3  3 


j  e  I 


Take  the  limit  of  each  side  of  (III c 3.5)  as  k  € 

T  fk3 

tends  to  «.  Note  that  (Atn''  must. have  a  limit  for 

each  j,  since  every  other  terra  has  a  limit.  Thus,  since 


A  has  full  rank  m,  {tt'' 


triust  have  a  limit. 


Let: 


(III. 3. 15) 


TT^  “  lim 
keN, 


Then : 


(III. 3. 16) 


c  +  log 


a’^tt*  +6*. 


Looking  at  the  bounded  problem  (III. 2. 6)  we  see 

that  (III. 3. 16)  is  just  the  optimality  condition,  where 

-6*  is  the  multiplier  on  the  lower  bound  inequality  x.  >  A. . 

J  ■  ’  -  J  J 

Alternatively,  if  we  look  at  the  expanded  'chemical 

equilibrium  problem  (111.2,7);,  and  taking  -4^  to  be  the 

multiplier  on  the  equation  x.  -  s.  -  />.  we  see  that  (III;.3.16), 

3  3  3 

together  with  the  equations.:. 


(III. 3. 17) 


log  SJ 


1  £  J  <  n 
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form  the  optimality  conditions  for  ('111.2.7)  .  Note  that 

for  yj  >  ,  we  have  >  0,  so  j^n  this  case, 

(III. 3. 17)  is  satisfied,  since  ■*  0.  If  y*  «  t.,  then 

Sj  «  0,  so  by  the  virtual  mole  fractions  theorem  II. 4  of  [7], 

we  must  have  s*  <  1.  But  from  (III. 3. 17),  «=  exp(-6p, 

*  3  3  3 

and  since  6'/  >  0,  clearly,  sf  <  1. 

3  3 

Thus  y*  e  M^(f|H).  QED. 

Corollary  III, 3. 3;  If  6*  from  Theorem  HI, 3. 2  satisfies 
«  0.,  then  y'^  c  M(f|'1I).  That  is  y*  solves  the  original 
problem.  In  particular  this  will  be  the  case  if  y*  >  t.. 

Proof;  From  (III. 3. 16),  if  «  0,  then 

(HI, 3. 18).  c  -F  log.  «  A^tt*. 

This  shows  y'*"  c  .M(f|h)  .  Clearly  «  0  if  y*  >  v Qgo. 

Corollary  III. 3.4;  If  M  (f|k)  contains  exactly  one  point 
x^',  then  is  a  convergent  sequence^  and; 

x'*  *  lim  y^^^ . 
k-.~> 


Proof :  Obvious . 
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4.  The  Other  Methods 

One  may  use  lower  bounds  in  the  Augmented  Quadratic 
Method  (AQM)  in  a  fashion  similar  to  the  way  they  are  used 
in  RQM,  and  indeed,  if  the  successive  step  sizes  are 
intelligently  chosen,  the  method  will  then  converge. 

This  is  relatively  easy  to  prove,  because  on  the  set 
[x  >  l]  the  second  partial  derivatives  of  F(x)  « 

S  Xj(cj  +  dj  log  Xj)  are  bov.mdedc 

Linear  methods,  recall,  had  trouble  with  the  orig¬ 
inal  lower  bounds  of  zero.  They  can  have  the  same  diffi¬ 
culties  with  nonzero  lower  bounds.  WliilC'  it  might  be 
possible  to  mo4ify  the  direction  found  by  a  linear  method 
so  that  it  would  not  violate  the  bounds,  this  would  make 
the  method  much  the  same  as  a  quadratic  method,  There 
seems  to  be  ho  convenient  way  to  use  lower  bounds  in  the 
linear  'methods. 
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IV.  DUAL  w:thods 


We  will  present  two  dual  methods.  The  first,  called 
here  the  Dual  Augmented  Linear  Method  (DALM),  v;as  developed 
by  Claaen  [4,  5],  as  a  method  for  refining  the  solution 
obtained  from  his  primal,  or  first  order  method,  ALM<, 

The  second  dual  method  solves  a  form  of  the  dual  of 
the  chemical  equilibrixmi  problem.  The  author  had  believed 
that  this  dual  formulation  was  new.  A  closer  study  of 
Rockafellar ‘s  work  in  duality  [13,  14,  15,  16],.  of  the 
work  of  Duff in,  et  al  [l]  on  Geometric  Programming,  and 
of  a  paper  of  Hamala  and  Milan  [2]  reveals  a  problem  of 
the  form  of  the  chemical  equilibrium  problem  may  be  con— 
'sidefed  to  be  the  dual  of  a  geometric  program.  Because 
the  relation  betv;een  a  problem  and  its  dual  is  reciprocal 
— i.e.,  the  dual  of  the  dual  is  the  primal-r-so  may  a 
metric  program  be  considered  the  dual  of  the  chemical , 
equilibrium  problem.  The  dual  formulation  presented;  here, 
for  the  problem  without  slacks,  may>  by  a  simple  change  of 
variables  be  shown  to  be  a  geometric  ;program. 

This  dual  problem  requires  one  to  maKiniizc  a  linear 
function  subject  to  nonlinear  constraintss  Experience,  has 
shovm  that  problems  with  nonlinear  constraints  are  in  getr- 
eral  more  difficult  and  less  efficient  to  solve  than  prob-. 
Icms  vdiose  sole  nonlinearity  is  in  the  objective  function. 
Therefore,  we  suggest  that  a  primal  method,  be  used  first 
to  obtain  an  approximate  solution  to  a  chemical  equilibrium 
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problem  perturbed  by  slacks  and  (in  the  case  of  quadratic 
methods)  lower  bounds.  With  the  resulting  values  of  the 
dual  variables  as  a  starting  solution^  a  method  may  be 
applied  to  the  dual  problem  of  the  original  chemical  equi¬ 
librium  problem — unperturbed  by  slacks  or  lower  bounds — 
to  refine  the  solution  obtained  by  a  prin^al  method. 

1.  The  Dual  Augmented  Linear  Method 

From  Section  11.1,  we  know  that  x  >  0, 

X  G  K(A,  b)  solves  the  chemical  equilibrium  pr  obi  era  in 
augmented  fo-m  if  and  only  if  there  exists  a  vector  n  such  that 

(IV.  1.1)  c^  +  d^  log  x^  -I-  d.  =  Afu  1  5  j  £  N. 

For  definitions  of  H,  E",  t  and:  cf,  see  Section  II.  1 

Solving  (IV. 1.1)  for  x^ ,  we  find  that: 

(IV. 1.2)  -  exp  l^^“^(A^n  -  c ^  -  H"^)]. 

Suppose  v^e  have  initial  estimates  of  the  nunibers- 
1  <  i  £  M,  perhaps  from  the  final  solution  from  a  primal 
method.  Surely,  for  any  n  at  all,  the  vector  x  computed 
from  (IV.  1  .,2)  will  satisfy  the  optimality  conditions  (IV.l.l). 
But  such  an  x  may  not  be  feasible.  The  nature  of  the  expo¬ 
nential  function  insures,  x  >  0,  but  perhaps; 

(W.1.3)  F  -  Ax  =  g  0. 
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Substituting  (IV. 1.2)  into  (IV. 1.3)  shows  that  g  may 
be  considered  a  function  ol  n.  Then  we  wish  to  find  n 
so  that : 


(IV. 1.4) 


0. 


If  our  initial  guess  tt  is  close  to  n*,  then,  taking  a 
Taylor's  expansion  of  g  around  u  to  first  order^,  it  is 
approximately  true  that : 


(iV.1.5)  0  =  g(n*)  g(^)  -) 


"I  • 


v:here  is  ah  MxM  matrix  whose  ii  element  is 

t)  t  . 

1  <  i,  j  <  M.  The  matri.x  is  computed  in  i.3],  p-.  24. 
to  be: 


(IV. 1.6) 


y. 


(T^ja)"'  a’^')  =  -R 


Substitute  into  (IV.1.5)  to  get; 

(r.M.7)  R4rr  «  g(r). 

K  is  the  .matrix  ..  it  occurs  in  the  primal  linear  method 
applied  to  the  augmented  form.  Sec  Section  II. 4. 

The  algorithm  based  on  OALM  is  as  foIlov;s: 

0.  Let  the  problem  be  in  augmented  form,  and 
let  n  be  an  initial  estimate  of  Tr’'. 

1.  Evaluate  by  means  of  (IV.  1.2),  g(T7)  by 
means  .jf  (TV.  1.3),  and  R  by  moans  ox 
(IV. 1.6). 


45 


I 


I 


h 


I? 


I;. 


2.  rind  satii-iyin;,  (IV.  1.7), 

3.  Replace  ”  by  ar.u  return  to  step  1. 

There  are  two  possible  termination  criteria.  We  might 
stop  if  g(~)  computed  in  ,step  1  v;ero  sufficiently  small. 


Alternately,  vc  could  stop  if  computed  in  step  2  were 
small  enough. 

This  method  docs  not  in  general  converge.  In  the 
first  place,  there  must  e:-:ist  an  x  >  0  solving  the  ori'*inal 
problem,,  or  so:..e  of  the  variables  n  munt  bccot..c  infinite. 

In  the  second  place,  oven  v.h>,  n  this  co  idition  is  satis  ria*.,, 
if  the  initial  "  is  too  far  fx*  >v.  the  opcimv.:  the  mcfnoci 


may  diverge,  ju'-'t  os  ;.,ny  .\\>vton',s  method 


7  aive: 


''6 


Vv  . 


i  '  :  ^ 


li. 


2.  The  Dual, Formulation 

Since  Che  reduced  form  of  the  problem  is  also  written 
as  a  linear-logarithmic  problem,  one  might  think  that  we 
could  develop  a  Dual  Reduced  Linear  Method.  Hov^ever,  if 
we  substitute  the  appropriate  quantities  for  cT^  and  F. ,  we 
discover  that  in  the  reduced  case-  (IV. 1.2)  becomes: 

(IV. 2.1)  =  x^j^  exp  (aTtt  “  5  j  £  n. 

In  this  case  we  have  no  way  of  defining  the  in  terms 

of  the  tt, 's,,  but  only  of  expressing  the  it.  *s  as  functions 
^  .  J 

of  n. 

This  does,  however,  lead  to  a  dual  method.  In  fact, 
it  suggests  a  new  form  for  the  dual  problem. 

From  [7],  Theorem  II. 4,  we  know  that  -x  e  H(A,b)  solves 
the  original  problem  (1.8)  if  and.  only  if  there  exists,  a 
vector  of  virtual  mole  fractions  ?  >  0  satisfying: 


X. 

3 


(IV. 2. 2)  ;  (b)-  =■  ^  ^  <  1 


kc<j> 


(c)  c  +  log  ?  «  A^n 


V  j  such  that  ^<j>  ^  0 
V  compartments  <j,> 
for  some  m-vec,tor  n. 


Of  course-,  this  depends  on  the  existence  of  y  e  H(A,b),  y  >  0. 
Compare  (IV. 2.1)  and  (IV. 2. 2)  (a)  and  (c).  This  sug¬ 
gests  v;a  consider  -  as  a  function  of  't.  That  is,  wc  let: 


(IV. 2 .3) 


(n).  =.  exp  (AjTT  -  Cj) 
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Then  defined  by  (IV. 2. 2)  (b)  is  a  function  of  and 

V7e  have  the  constraints  on  n  that; 


(IV. 2. 4) 


<j>. 


If  we  compute  derivatives  of  we  find  that 

(IV,2.5)  A  ?^(r)  =  §  (n) 

On  “* 

where  the  symbol  “  indicares  a  definition.  Also, 

(IV. 1.6) 


2  -V 

Sincc  ^^(”)  >  0  for  every  v  T^^^(n)  is  positive  semi- 


definite.  Thus  the  function  T^^.^("')  is  convex,  and  the 
constraint  set  defined  by  (IV. 2. 4)  is  a  convex  set. 

The  dual  may  be  foxT.nuatod  for  th-c  problem  witl;  or 
without  .slacks  (see  [?],  or  the  comii'ent  at  the  end  of  Section 
II. 6  above).  Ve  will  do  it  both  ways,  and  show  that  tie  dual 
v7ithout  slacks  i.s  a  limiting,  case  of  the  dual  wich  slacks. 

Ii  wViat  follows,  we  assamc  that  there  exists  y  n(A,b) 
.-satisfying  y  >  0,  and  chat  the  solution  sot  M(yjll)  of  the 
problem  without  .slacks  is  bounded  and  nonempty. 


Theor cr.  IV. 2. L;  Let  tire  problem  have  slack  s<j>  >  0  i 
each  phase  <j>.  Let  n"  solve: 


.n 


(IV. 2. 7) 


(  Max  w(tt)  =  [b^r  +  log  (1  - 


We  take  log  0  =  — . 

KAr:*) 

Define  x?  =  — ^ ^ - r  for  each  j,  1  <  j  <  n. 

J  1  -  ■  ~ 

Then  is  the  unique  solution  to  the  chemical  equilibrium 
problem  with  slacks 

Proof :  Since  M(f1h)  is  bounded  and  nonempty,  and  since 
there  exists  y  >  0,  ye  H(A,b),  [7],  Theorems  III.l  and  IIIo2 
us  that  there  exists  a  unique,  strictly  positive  solution 
y*  to  the  pjroblem  with  slacks,  and  an  associated  vector  of 

p* 

multipliers  Clearly, 

y-'  ^<j> 

(IV. 2,3)  >:  ^  <  1. 

^  k€<j>  y^.^  .  s  ... 

y<2>  -r  <J>  ^<J>  <J> 

It  is  easy  to  see,  then,  that  must  also  satisfy 
<  1,  or  else  v(-"') 

f7j,  Ler'm.e  III. 2  .  I  shows  that  w{~)  Is  a  concave  func¬ 
tion  of  Thu.s,  since  is  surely  in  the  interior  of 
its  con.otraint  set,  we  know  chat: 


(iy.2.S')  -  b  -  ^  .. 


A .  s  ^ .  s .  ( V  ^ ) 


j  1 


:r-  =  b  -  Ax 


klso,  xj  >  0  and  finite. 
Finally, 


(IV. 2. 10)  ^ 


/  \  / 
. '  -L. 
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c 

Thus,  by  the  definition  of  (^)  (Equation  (IV. 2. 3))  we 
know  that : 

(IV. 2.  U)  H-  log  =  A^'n*  1  <  j  <  n. 

Therefore,  by  (I,V.2.9)  and  (IV. 2. LI),  solves  the  prob- ’ 
lems  with  slacks.  QED. 


Problem  (IV. 2. 7)  is  the  dual  problem  with  slacks. 

To  show  it  is  truly  a  dual,  v/e  must  show  that  w(;t‘’')  is 
equal  to  the  optimal  value  of  the  primal  objective  fui  otion. 

Theorem  IV. 2. 2:  Let  solve  (IV. 2, 7),  and  solve  chc 
primal  problem  with  slacks.  Then: 


(,XV.2.12)  F(x*,  s)  «  5:  -p  log  ftp  +  =■  w( 


Proof:  The  quantity  1  -  r  k!‘' 

ke<j> 


since  in  each  compartment,  the  mole  fractions  (including 
that  of  the  slack)  must  sum  to  one.  Thus  by  (IV. 2. 10); 


(IV. 2. 13) 


Inov:  substitute  (IV.  2. 11) 
find  that 


*nd  (IV. 2. 13)  int.<  (IV.  2  12)  to 


?(:<’■',  s)  =>  w(n'‘-).  QiiD, 


Note  that  for  any  x  s  H(A,b),  F(v:,s)  >  P(x*,  s),  anc. 
for  any  n  satisfying  ■^<j>(~)  <  1  V<j>,-  w(tt)  <  w(n"). 
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Thus  weak  duality  is  also  satisfied.  The  theorem  proves 
strong  duality. 

The  dual  problem  without  slacks  is  similar. 


Theorc!*'  IV,  2.3:  Let  tt’  solve: 


(IV. 2. 14)  Max  b 


T„ 


s . 


v<j; 

^<j>  ' 


Let  be  the  value  of  the  multiplier  at  th.: 

optimum. 

Define  xV  « 


Then : 


x''  e  M(F !  H)  . 

Proof;  Note  that  since  the  constraints  are  inequalities 

*’V 

of  the  sense  (<)^  and  we  are  maximizing,  ^  0)  c’>nd 

=  0  if  <  1. 

•<j>  <j> 

That  (n’',  *.")  solves  (IV. 2. 14)  requires  that  rr*  .solve 
the  uncon  strained  La.grangian  problem: 


(IV, 2. 15)  Max  ib- 


<3> 


Clearly,  this  is  a  concave,  differentiable  function  that 
achieve.'i  its  ma:-:3.mum  where  its  gradient  vani.shes .  Thus 
(from  (IV. 2. 5)) 


(IVo2.l6)  b  -  ^ 


r  1, "  i,  rTr'"\  s  b  -  A'-’' 


-  0, 
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Since  _>  0,  clearly  x*  >  0.  Since  if  Xj^^  >  0, 

_  (n*)  =  1,  we  may  make  the  identification  ~  ^<j>’ 

and  be  assured  that  if  ^<>j>  ^  then: 


(IV. 2. 17) 


That  is,  X*  e  H(A,b)  (because  of  (IV. 2. 16)  and 
X*  >  0),  and  ^(n'*)  is  a  vector  of  virtual  mole  fractions 
satisfying  (IV. 2. 2)  for  x  =  x*.  Thus  by  l'7j,  Theorem  II. 4, 
X*  c  m(f1h).  QED. 


It  is  easy  to  show  that  both  strong  and  weak  duality 
hold  in  the  case  without  slacks.  The  proof  is  much  the  same 
as  for  Theorem  IV. 2 . 2 . 

Problem  (IV. 2.14)  Is  the  dual  problem  v;i thou t  slacks. 

We  now  wish  to  show  that  it  is  a  limiting  case  of  the 
dual  with  slacks. 

Theorem  IV. 2. 4:  Let  A  have  full  rank  m. .  Let  be  a 

sequence  of  slack  vectors  satisfying  s^'^^  >  0,  lim  s^^^'  =  0. 

k-0 

Let  solve  (IXL2.7),  the  dual  with  slacks  s^^^\  Then 

(i)  is  the  unique  solution  to  (IXV2  ..  7) 

fkX 

with  slacks  s^  ^ 

(ii)  The  sequence,  [^^^^has  at  least  one-  limit 
point  (ie  subsequence  converging  to)  tt*. 

(iii)  n*  solves  (IV. 2. 14),  the  dual  without  slacks. 

Proof :  Since  M(F!iI)  is  bounded  and  nonempty,  and  there 
exists  y  0,  y  e  fl(A,b),[7],  Theorem.^  III.  1,1  and  III. 1.2  shov; 
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C"*‘  "'S'  n 

t:h?t  the  primal  problem  x^ith  slacks  '  possesses  a  unique^ 

strictly  positive  solution  By  Theorem  IV.2;1, 


clearly 


>  0. 


By  (7j,  Lemma  II.  11,  is  unj.que.  But  by  definition 


(IV. 2. 13) 


log  A^nW. 


Since  A  has  full  rank,  and  is  unique,  is 

unique,  proving  (i).. 

'^y  Theorcra  III.  1.5,  there  exists  a  subsequ' nec  ^•  of 
(1,  2,  such  that  -T'’  «  iim  is  &  vector  cf 

virtual  mole  fractions  for  the  problem  without  slacks. 

•f. 

Since  >  0,  x-^e  take  limits  as  k  -*  k  e  N,  ol.  (IV.  2.  IS). 

Clearly  then,  11, m  A  exists,  and  since  A  ha.s  full 

key 

V*  .  (Vs') 

rank,  rr’  ==  lim  •'■•x  ^  also  exists,  proving  (ii). 

Finally,  by  continuity, 


Since  '  is  a  vector  of  virtual  mole  fractions  for  the 

original  proble  by  .cheoram  IV. 2. 3,  solves  (IV..2.,14).  Q.'C.r. 
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3.  Solvinp,  The  Dual 

A  pair  of  vectors  (n*,  \*)  solves  the  duaj ; 

(IV. 3 . 1)  Max  b'^TT 

s.t.  ■-<j>(^)  5  1  :  ^<j> 

if  and  only  if  they  satisfy  the  Kuhn-Tucker  conditions, 
derived  in  the  usual  way  from  the  Lagrangian. 


(IV. 3. 2) 
(IV. 3. 3) 
(IV. 3.4) 


=  b  - 


T. 

<]> 


ks<j> 


=  0 


(n*)  <1  V  <j> 

>  0,  and  X*j^(l  -  “0  V  <j>. 


If  instead  we  have  an  initial  solution  (v,  x)  which 
may  not  satisfy  (IV, 3. 2-4),  wc  may  compute  corrections  of 
(rr,  x)  by  expanding  g(r:,  x)  and  T^j^(7i)  around  the  knov7n 
initial  point.  Using  always  linear  approximations,  and 
making  the  associations: 


(IV. 3.5)  '"j  “  ^<j> 

we  have  from  (IV, 2.5)  that  An  and  AX  must  satisfy: 

(IV. 3. 6)  RAn  +  ■■=  g(Ti,  X) 

-1) 

where  R  “  AX.a'^. 

Noticing  that  g(rr,  x)  =  b  -  X:  we  may  let 

^<j>  value  of  the  multiplier,  and  write  (IV. 3. 6) 

as : 


t 


5A 


(IV. 3. 7) 


Ri  '  +  T.  -  b 

•j  ■  J 


<J'- 


•i-  (1  - 


>><j>  i  0.  <!<p  i  0.  =0 

where  we  have  included  the  complementarity  conditions 
(IV. 3.4). 

Notice  th.it  (IV. 3. 7)  is  equivalent  to  the  quadratic 


program, 
(IV. 3. 3) 


Min  R.X'0  - 


s .  t .  .“S' 


Notice  also  that  the  matrix  R  is  exactly  that  found  In  RLM. 
For  these  reasons,  we  call  the  method  based  on  this  develop¬ 
ment  the  Dual  Reduced  Qiiadratix  Method,  or  DRQM, 

Theorciv  IV. 3.1;  If  H(f1h),  the  solution  set  to  the  origi-^ 
nal  proolea.,  is  nonempty,  there  always  exists  Arr  such  that 

~  i,  for  every  <j>.  That  is,  the  qurd- 
i*atic  program  (IV.  3.  S)  is  always  feasible. 

Proof ;  Let  c  M(f!h),  and  n"'  be  an  associated  vector  of 
multipliers.  Then  clearly. 

<  I  V  <i>- 

Since  is  a  convex  function,  V7e  know  that  (from 

(r/.2.5)). 


(iV.3.9) 
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Thus  An  ■«  -  ti  ig  feasible  for  every  n.  ^Eb; 


OnforCLinately,  it  is,  not  always  true  that  (17^3. 8) 
has  a  solution..  The  quadratic  form,  thougu'  always  -positive 
semi-definite,  need  not  be  strictly  convex  (ie  positive 
definite).  In  this  case,  ’'(’IV.l.d)  may  be  unbounded. 

The  GasiGS.t  method  for  coping  with  problems  of 
unboundedhess  would  be  to  arbitrarily  bound  Att.  Other 
methods  may  suggest  themselves  to  the  reader. 

The  algoritlim  for  DRQM  is  as-  follows; : 

0.  Find  ah  initial  '(fr^  x) .  tt  could  be,  for 
example,  the  finrl  multipliers  found  by 
a  primal  reduced  method.  ^<j> 
set  equal  to  ^<j>* 

A 

i.  Gpmpute  .Xj.  =  ^ 

S.olve  the''  complementary  pivot  problem 
(IV, 3. 7)  for  Arr  and  x‘. 

If  Ah  is  !5uff3;cientl„  •'all.  or  if  Ratt 
is  sufficiently  small j  terminate . 

Otheni/ise  replace  X-  by  X''  and  n  by 
Ti  +  att.  Then  return  to  step  1. 


2. 


3. 


H  =? 


The  convergence  criterion  "if  A^  is  sufficiently  small"  is 
clear.  Mote  that  R'Att  =  b  -  E  '‘<j>®<j>(^r)s  If  this  is 
small,  then- x^  ?  ^<j>  i^Gavly  fea-sible;.  The  other 

quantity  that  one  should  check  iS;  But  this  cannot 


much  'exceed  1  if  An  is  small. 
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Comparison  of ,„the ■  Dual  MeChods 


-Simple  algebra  shows  that  the  matrix.  K>  defined  by 
(IV..  1.6)  can>  be  partitioned  as  follows: 


♦  •  •  P. 


(iV>.4;l)  R  * 


^^1> 


<p>  ‘ 


T 

where  R  is  the  matrix  AXA  of  .Section  IV. 3, 

and  eacK  ®<j>  defined,  one  for  each-  compartment,,  by: 


(xV.4.2): 


^  Av'V 

■r  ke<j> 


If  we  renaii’.e  ^the  variables  n^,  m  +  1  <  i  <’  M  in  BALK, 
calling  them  we  haye-  from-  (IV,  1,7):,  (IV.., 1.3)  and 

(IV, 4. >1)  that  we  wish  to  solve: 


Uy.4,,  3) 


RAt  +  V  «.  .b  »  Ax 


“  X<i  ^  -  1C  X,  . 


Clascn  [5]  suggests  that  the  right-hand  sides  of 
equations  m  +  1,  ...,m  +  p»Mbe  replaced  by  zero,  but 
the  author  isees  no  reason  for  doing  so. 

In  our  nev7  notation,  given  multipliers  (h,  ri)  we  may 
compute  from  (IV..I.2>  and  the  definition  of  JC  (see  'Section 


(F,4'o4) 


(iy.4.5) 


Xj  =  exp  (a:tt  -  »  1  +  n<j>)  1  <  a  < 


V  <j> 


is.  the  muitip^er  in  the- equation  ”  x,  -  ^<:;>  “  0- 

Combining  (iV.'4.4)  and  '(IVV4.5),  we  find  that  computing 

k.  from  (IsV4l.2)  and  computing  ^.(n),  from,  (IV. 2. 3)  yield 
J  "  j  ~ 

the  same  result.  That  is,, 


(IV.4:.6J 


=  exp^  (aTtt  «  c^)  » 


That  is,  comparing  (IX. 4:. 2),  the  definition  of  4hd. 

(iV.2‘'..5).,  the  definition  of  we  see  that': 


(IV. 4-.  7> 


Let  'US  then  make  the  following  changes.-  in  ti'V-4.3X: 
(1).  tec 

(ii),  l-et  an* 

(iii)  Divide  each  .of  the  last  ,p  equations  of  (IVo4.3) 
b,y  the  appropriate 
Then  (Att,,  \')  should  satisfy: 


-(IV.,4„8) 


RAtt  -t  V,  “■  b 

<i>  <3i> 


T  -  1 
<jv  ^  • 


Compare  (IV.4.,8y  with  (.IV.3o7')o  The  matrix  of  detached 
coefficients  and  all  the  constant  terms  are  the  same;. 
The  difference  is  that  in  DACM,  the  variable  may 


5 ;  Degeneracy  cind  jthe  Dual.  Methods 

We  fovin4  that  none  of  the  primal  methods  coul'd  cope 
A«7i.th  a  degenerate  problem  in;  a  natural  way.  Xt  was 
nec.essar.y  to  insure  that  the  solution  set  M(f|h)-  contained 
at,  least  one  strictly  .positive  point,  either  by  using  lower 
bounds  or  slacks.  Xt  x^ras,  .at  least  helpful  to  insure  that 
if  the  .problem  had  a  solution  at  all,,  it  was  uniq.ue. 

This,  was-  dop'd  by  adding  slacks. 

DALH  has  similar  difficulties.  By  Equation  ,(IV..].2) 
everj'  Xy,  including  the  sums  i^ust  necessarily  be 

■positi?;e.  They  can  approach  zero  only  if  the  multiplier;, 
approach,  infinite  values.  Thus  if  a  problem  has  only 
-degenerate  soluitions,  or  if  all  solutions  are  too  nearly 
degenerate,  this  method  will  fail. 

DRQH,,  on  the  other  hand,  or  any  method  used  for 
solving  the  problem  in  its  dual  form;,  can  accomodate 
problems  wich  ;degenerate  solutions.  It  only  necessary 
to  insure  that  no  vector  of  virtual  mole  fractions  the 
method  arrives  at  is  degenerate,  or  nearly  so.  If  '  is 
the  vector  in  question,  then  for  some  n, 

c  +  log  ?  ■=  A-'n. 

li  “  P  o«  3-  e  for  some  .small  g  >  .0,  then  one  or  more 

of  the  must  be  large.  Of  course,  K,  must  be  very  small 

•3 

indeed  bdiote  log  is  a  large  negative  munber.  Th  -  s 
problem  rarely  oc.curs,  and  when  it  does  it  is  usually 
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evidence  that:  some  species  I  has  been  included  that  has 
for  all  .practical  purposes  no,  impdri;ahce  in  the  system,  in 
question. 

The-  author  suggests  that  the  .problem  first  be  solved 
using  one  of  the  primal  methods  with  slacks,  and'  if 
necessary,  bounds;  If  the  slacks  used'  are  large  enough, 
and  the  .primal  solution  sufficiently  accurate,  the  multi¬ 
pliers  h  corresponding  to  the  final  iterate  of  the  primal 
procedure  will  satisfy: 

A  method  for  solving  the  dual-  problem  may  therefore  stsirt 
with  a  feasible  point. 

Starting  with  the  point  r:  described  above,  a  , method 
for  solving,  the  dual  can  find  not  only  a  solution  to  the 
original  problem  (,i.c..,  v;iuhout  slacks  or  bounds).,  but 
can  express  all  the  solutions.,  That  is,  if  in  problem 
(IV. 3.7'),,  wc  find  that  '^rr  «  0,.  then -every  solution,  may  be 
r.;COvere(i  as  a  solution  of: 


V*  Q 

'  •Vj>- 


=  b 


X...  >  0 

<3>  -- 


0- 


See  [71  Leunia  ill. 2. 


6.  Corivcrgonce  of  Dual  H^chods 

— II — 1--; — --  1 — :■■!  .|.^.-,',>.>,.I.,>». 

As  they  stands  neither  duaj.  niCthod  is  assured  of 
converging  to  an 'Optimal  solution  aithoiigh  if  the 
i.tarting  'S  is  sufficiently  close  to  n*  each  method  will 
generally  find  an  optimal  solution. 

There  are,  however,  other  methods  for  solving  the 
dual  problem  (IV, 3.1),  some  of  which  are  sure  of  converg- 
i’'g,  whatever  the  initial  point.  Examples/  of  such  methods 
iriciude  Rosen  [17],  Kalfoh,  et  al.  [18’],  Daniel  ;[19'], 
Fletcher  &  Pov/etl  [20,  21],  ZoutendijU  [22];,  several 
methods  found  in  [lO],  particularly  in  a  chapter  by  Wolfe, 
and  UhavTa  [23]. 
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/vppeadix;  The  Ini tial  S piution 

The  primal  algor i'thns  presented  iri  the  body  of  this 
work  all  require  a  starting  composition  x  satisfying; 

Ax  =  b 

X  >  0. 

Clasen  [5]  has  developed  tv;o  methods  for  finding  such  ah 
X,  the  projection  method  and  the  linear  programming  metho^’.. 

1.  The  General Iz.cd  Projection  Method 

It  is  actually  not  true  that  the  priiaal  algorithms 
tequire  a  starting  composition  v?hich  is  feasible  and  strictly 
positive,  although  all  of  them  must  start  v;ith  a  vector  y  >  0. 
One  may  simply  forget  that  Ay  j-  b  and  use  any  primal  method 
to  find  a  new  composition  x.  Clascu([5],  p.  5)  suggests 
that  y  be  "...  the  exact  [optimal]  solution  of  another  probr.- 
lem  V7hich  differs  from  the  one  being  conbidered  in  relatively 
minor  ways . " 

If  an  initial  infeasible  but  strictly  positive  y 
is  used  in  either  of  the  linear  methods  (AU-I  or  RLH), 
i=t  may  b'e  that  the  x  obt'iincd,  although  it  ’rill  satisfy 
'Ax  »  b,  will  not  be  positive.  One  may  either  admit  defeat 
and  use  the  linear  programming  method,  or  use  a  new  start¬ 
ing  point  u  ~  ciy  +  (1  -  cx)x,  for  some  0  <  a  <  1  such  that 
u  >  0;.  The  projection  method  of  Clasen  [5],  is  equivalent 
to  using  the  vector  y  >  0,  Ay  4=  b  as  the  starting  point  in 
ALM. 
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The  avithpr  thinks  it  better  to  use  y  >  Ay  .'j'  b  as- 
a  starting  solution  in  one  of  the  quadratic  n^ethod's  u’i'th 
lower  bounds.  The  new.  point:  x  ithat  is  .generated  will  sat~ 
isfy  Ax  «  b  and  x  >  t  so  long  as  such  an  x  exists<i 

2.  '  The  Linear  programming  Method 

This  method  can  be  found  in  Clasen  fS],  pp.  9—14'. 

If  an  initial  guess  y  is  not  available  for  the  pro¬ 
jection  method^  or  if  projectioa  has  failed,  one  may  use 
the  L,.,  P.  method  instead. 

We  wish  to  find  a  point  x,  satisfying^;.. 

A:<  «  b 

(A. 2.1) 

X  >  p. 

But  X  >  0  if  and  only  if  its  smalles  t  ccm'ioi-ont  x.  is  also 

.3 

positive.  Thus  for  any  point  x,  we  let; 

V  <  min  X . 

"  j  J 

and  define  new’^  variables  y  by: 

y j  -  X,  =  V. 

Substituting  in  (A.  2^1),  we  'wish  to  find  (y^,.  v)  such  that.: 
(A. 2. 2).  ^  A,  }v  =»  b 

j  J  J  W«1 

y  >  O',  V  >  0. 
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n 

Letting  Q  »  S  A,  ,  the  obvious,  thing  to'  do  is  to  find  the 
k 

optii^ial  solution  v*’).  to: 


Max  V ,, 

(A. 2. 3)  s.  t.  Ay  +  Qv  *  b 

y  >  0. 


If  V*  >  0'>  then  the  feasible  composition  x,  defined  by: 


(A. 2. Ay  Xj  «  y^^-  +  V'' 

satisfies  (^A.2. 1). 


^1.  Degenev-ate  Cases : 

The  advaiitage  c,f  the  L-.  F.  method  over  the  projec¬ 
tion  method  usi.ng  the  quadratic  algoritlrns  .is  that  v.'hilo 


both  will  fiiid  a  strictly  positive  feasible  if  one  exlotc, 
the  L.  P.  method  also  discovers  (i)  if  the  matrix  A  has 


full  rank  (and  if  not  v/hich  rows  arc  linear  combinations 
of  the  others),.^  (;ii)  if  the  et[uations  J\y.:  «  b>  x  >.  0  can 
be  .satisfied  at  all,  and  (iiij  if  there  is  a  feasible  x 
but  no  strictl).  positive  feasible  x^  v/hich  variables  x. 
are  constrained  to  be  zero.,  A  discussion  of  these  points 
•may  be  found  in  [6],  pp,  23-2'5. 


(i)  The  Rank  of  A, 

To  solve  the  linear  program  •:(A.2.3),  one  must  first 
find  a*  basis^,  i.c.^,  a  set  of  m  columns  of  the  matrix  [A,j  Qj 
V7hich.  fortn  a  nonsingular  matrix.  It  is  easy  to  show  that 
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since  Q  is  a-  linear  combinatipn  of  the  columns  of  A,  [A,  -Q] 
possesses  a  basis  If  and  only  if  A  does.  The  matrix  A  has 
rank  m  if  and  only  if  it  possesses  a'  basis. 

(ii)  Inf  ea  sib  il.it  y 

If  a  basis  can  be  founds  then  the  equations  Ay  ^  .Qy  “  b 
arc  alv7ays  solvable.  Furthermore,  there  is,  a  solution  with, 
y  >  0.  (This  is  because  if  Ay  *=  b,  wp  may  let  v  «=  min  y., 

and  lot  y j ‘  »  -  v.  Then  y'  >0,  and  Ay’  +  Qv  “  b.) 

Let  (y*,  v^)  be  an  optimal  solution  of  .(A»2, 3), .  If 
V*  <  0,  then  there  is  no  feasible  '.solution  to  the  problem. 
That  isj  there  is  t\o  composition  x  >  0  satisfying  Ax  «  b. 

If  there  were,  of  course,  we  '•'ould  have  y  «  x,  v  «  6  a 
feasible  solution  to  (A. 2. 3),  and  v  >  v^. 

(iii)  Positivity 

If  0,  we  must  fine’  at  least  one  Xj  constrained 

to  be  5icro  by  the  conditions 

Ax  “  b 

(A. 3.1) 

X  >  0. 

To  find  such  an  equation  let  he  the  vector  of  optimal 
Lagrange  multipi  i  irs  a.ssociated  v/ith  the  optimal  solutioxi 
(yA-,  v>)  of  (A. 2.3). 

From  the  du.  lity  theorem  of  linear  prograimning, 

(A. 3. 2)  b'^'x’^  **  v''-  “  0. 

6-7 


V 


'T  - 


Since  V7e  are  maximizing^  each  coluitin  should  'price 
out.''  negative.  Thus: 

(A. 3. 3)  1  -  <  0 

and  for  each  other  column: 

(A, 3.4)  ~A^^X»<o. 

n 

Because  Q  *  Z  A.^  we  see  from  (A. 3. 3)'  that: 
j«l  ^ 

(A. 3. 5)  Q^X*  >  1  ^  ° 

for  at  least  one  j. 

Let  us  form  a  new  equation  by  taking  the  linear  con~ 
blnation  X*  of  the  original  equations  (A. 3.1). 

(A. 3. 6)  Z  ti-Xj  =  0 

T 

where  a.  «  A.  ^  and  the  right-hand  side  comes  from.  (A. 3. 2 

•J  •J 

By  (A. 3.4);  ttj  >  0  for  ail  1  <  j  <  n.,  and  (A. 3. 5) 
insures  that  at  leasSt  one  a.  >  .Q..  Thus  (A.3.c6>  show.s  that 
at  least  one  must  be  zeroij 

We  'may  delete  each  co3;umn  A.  from  the  problem  such 

j  i.. 

that  >  O';  and  solve  (A,  2. 3)-  again.  While  there  is  no 
-guarahteq  that  the  new  v*  for  the  feduecd  .problems  wi3.1  be 
positive.;,  we  know  that  y*  cannot  be  negative.  We  may  con¬ 
tinue  solving  and  deleting  cither  until  v*  >  0  or  the  nunv- 
ber  of  columns  is  exactly  m.  At  this  point  wc  know  that 
■(Av3,.;ll  has,  a  Unique  solution  x. 
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Tb"  procedure  never  allows  us  to  strike  put,  a  basic 
co-luinn,  since  eacb  basic  column  "prices  out"  to  zero. 

Thus  there  will  alvrays  be  at  least  m  columns  rmaining, 
and  the  rank  of  the  matrix  can  never  diminish. 

> 

4 ..  Remarks 

_  Usually,  if  a  strictly  positive  feasible  solution  x 

cannot  be  found,  it  is  evidence  that  the  problem  is  incor¬ 
rectly  formulated.  The  same  is  true  if  the  equations  Ax  »=  b 
arc  redundant,  so  that  a  basis  in  the  L.  P.  method  cannot 
be  found. 

The  author  suggests  that  if  any  of  the  .degeneracies 
of  Section  3  occur,  the  problem  solver  stop  and  examine 
his  data,  instead  of  dropping  redundant  equations  or  var¬ 
iables  constrained  to  be  zero. 
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single-  jt-  multi-phase  chemical  equilibrium  problem  may  be  expressed  as  a 
nonlinear  programm'ng  problem.  Thus. to  find  the  quilibrium  cernposition  of 
of  chemical  system  one  need  only  minimize  a  particular  nonlinear  function 

(the- free  energy)  subject  to  certain  linear  equality  constraints  (the<mass- 
faalance  laws)  and  nonnegativity  conditions.  The  free  energy  is  defined  and 
concinuous  on  the  nonnegative  orthant  of  n-space.  In  the  interior  of  it's  domain 
It  IS  infinitely  differentiable,*,  but  at  the  boundary,  the  directional  derivative 
may  become  infinite. 

The  phrase  "chern'cal  equilibrium  problem"  refers  only  to  a  problem  with  a 
particular  mathematical  fo.’.m.  Such  problems  arise  in  many  cheailcal  problems 
not  classically  denoted  ar  equilibrium  problems.  In  addition,  the  dual  to  a 
,  gopmptric  prograrrmlng  problem  has  this  forni. 

•  lie-present  six  iterative  methods'  for  soTving  the  chemical  equil  ibrium, 

'problem,  four  pnmal  and  two  dual.  In- chemical  terms.,  each  composition  oro- 
(luced  by  a  primal  method  satisfies  the  mass-balance  laws  while  successive 
Iterates  more  nearly  satisfy  the  mass-action  laws.  Dual- methods  do  the  reverse 
we  present  two  formulations  of  the  chemical  equilibrium  problem  as  a 
mpre  gener£  linear-logarithmic  problem,  and  two  methods  for  solving  the  general 
problem.  Of  the  four  resulting  primal  methods,  two  (the  Linear  methods)  Led 
not  converge  to  an  optimal  solution.  The  other  two  (the  Quadratic  uietliLs) 
cLvorgr  f  appropriately  modified  chemical  equilibrium  problem,  will  gertalr.ly 

n*s  io  the  optimum,  unless  the  starting  point 

If  ^“^f)tientTy  close  to  Jie  optimal  solution,  flor  has  the  autfior  been  aMe 
to  modify,  the  Linear  dual  method  so  that  it  Is  sure  to  converge.  However,  the 
.f^thod  is  derived  from  a  formulation  of  the  dual  problem  to  the 
l^uilibrium  problem  as  a  geometric  programming  problem.^  Many  standard 
nonlinear  programming  will  certainly  converge  when  appliedLo  this 
dual.  Any  suen  method  allows  oe.e  to  ignore  tlie  possibility  that  the  oriHihal 
problem  13.5  fionusique  or  a  degenerate  solution,  ^ 
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